-- Logs begin at Sun 2022-03-20 15:28:23 UTC, end at Sun 2022-03-20 16:38:08 UTC. -- Mar 20 16:03:26.281641 dv-cinder-834172-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 20 16:03:26.289238 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Mar 20 16:03:26 2022] *** Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: nodename: dv-cinder-834172-2-iscsi Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: machine: x86_64 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: clock source: unix Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: pcre jit disabled Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: detected number of CPU cores: 4 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: current working directory: / Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: detected binary path: /usr/bin/uwsgi-core Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: your processes number limit is 47680 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: your memory page size is 4096 bytes Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: detected max file descriptor number: 2048 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: lock engine: pthread robust mutexes Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: thunder lock: enabled Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 20 16:03:26.293167 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 20 16:03:26.336722 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: Python main interpreter initialized at 0x55d4a55159c0 Mar 20 16:03:26.336722 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: python threads support enabled Mar 20 16:03:26.336722 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: your server socket listen backlog is limited to 100 connections Mar 20 16:03:26.336722 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: your mercy for graceful operations on workers is 90 seconds Mar 20 16:03:26.337121 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: mapped 403077 bytes (393 KB) for 2 cores Mar 20 16:03:26.337198 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: *** Operational MODE: preforking *** Mar 20 16:03:26.337425 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: *** uWSGI is running in multiple interpreter mode *** Mar 20 16:03:26.337425 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: spawned uWSGI master process (pid: 79864) Mar 20 16:03:26.337626 dv-cinder-834172-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 20 16:03:26.338747 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: spawned uWSGI worker 1 (pid: 79875, cores: 1) Mar 20 16:03:26.338747 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: spawned uWSGI worker 2 (pid: 79876, cores: 1) Mar 20 16:03:26.338747 dv-cinder-834172-2-iscsi devstack@keystone.service[79864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 20 16:03:31.968265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 20 16:03:31.968265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: from cryptography.utils import int_from_bytes Mar 20 16:03:31.969068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 20 16:03:31.969068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: from cryptography.utils import int_from_bytes Mar 20 16:03:31.969179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 20 16:03:31.969179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: from cryptography.utils import int_from_bytes Mar 20 16:03:31.969179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 20 16:03:31.969179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: from cryptography.utils import int_from_bytes Mar 20 16:03:32.013599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 20 16:03:32.013804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 20 16:03:32.013877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 20 16:03:32.013957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] command line args: [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 20 16:03:32.014027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 20 16:03:32.014299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 20 16:03:32.014394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] command line args: [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 20 16:03:32.014463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ================================================================================ {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 20 16:03:32.014524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 20 16:03:32.014676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] admin_token = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.014775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ================================================================================ {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 20 16:03:32.014843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] config_dir = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.014902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] admin_token = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] config_dir = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] config_source = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] debug = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] config_source = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.015589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.017903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] debug = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.017903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_config_append = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_config_append = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.018961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_dir = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_dir = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_file = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_file = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.019954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.020954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.021338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] publish_errors = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.022079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] publish_errors = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.022304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.022478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.022665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.022850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.023070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.023229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.023452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.023704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.023889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.024075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.024258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] standard_threads = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.024450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] standard_threads = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.024644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.024829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025780 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] use_journal = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.025970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] use_journal = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.026194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] use_json = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.026365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] use_json = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.026587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] use_stderr = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.026759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] use_stderr = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.027033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] use_syslog = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.027209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] use_syslog = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.027343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.027475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 20 16:03:32.027642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.027781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.027915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.028883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.029992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.030945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.031998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.032894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.033945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.034078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.034206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.036640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.036781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.036916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.037837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.038988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.039881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.040921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.041957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.042082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.042207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.042207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.042476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.043669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.043669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.044892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.045147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.045346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.045510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.045697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.045917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.046095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.046330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.046493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.046678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.046864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.047091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.047252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.047444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.047631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.047815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.048902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.049897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.050916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.051991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.052896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053021 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.053852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.054961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.055987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.056904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.057946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.058997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.059899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.external = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.external = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.060987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.password = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] auth.token = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.password = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.061928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] auth.token = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.062894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063021 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.063938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.064967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.065915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.066978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.067880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.068933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.069907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.070965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.071885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.072930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.073970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.074947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.075989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.076900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.077948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.078879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.079930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.080973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.081932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.082890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.083937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.084887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.085931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.086893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.087932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.088979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.089880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.090976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.091873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.092918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.093940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.094910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.095936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.096878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] role.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] role.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] role.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.097925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] role.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.098924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.099972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.100878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.101775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.102872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.103952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.104989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.105892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.106976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.107918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.108895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.109964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.110930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.connection = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.111981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.connection = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.112121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.112271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.112401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.112604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.112739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.113874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.114984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.115970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.116884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 20 16:03:32.117127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.117127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 20 16:03:32.117127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 20 16:03:32.127426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.127658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.127796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.127928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.128067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.128340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.136515 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.136736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.164692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.164921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.165075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.165209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.223254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.223499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.267949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.268220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.268550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.268782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.332542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.332829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.332992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.333944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.334073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.334073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.358686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.358939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.359910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.360040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.360170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.360308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.360440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.360570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.371535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.371759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.384293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.384564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.384719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.384879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.385863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.386002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.386132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.386291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79875) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 20 16:03:32.402787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.402995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 20 16:03:32.403266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.403459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.403600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 20 16:03:32.403734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 20 16:03:32.403734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.403995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.403995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 20 16:03:32.404255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.404908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.415139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.415415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.415664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.415833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.415970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.416103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.416381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.416656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.424046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.424809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.427321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.427637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.427879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.428249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428515 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.428913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.429990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.430119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.430295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.430295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.430551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.455825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.456305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.457419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.457674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.457868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.458169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.462859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.463252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.463461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.463606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.463740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.463915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.470701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.470928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.471074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.471255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.475385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.475575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.475716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.475865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.475999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.476943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.477074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.477212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.477343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.477474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.495884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.496164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.496374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.496627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.500643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.501074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.504283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.504677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.504886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.505075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.509579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.510615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.513144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.514122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.516720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.517015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.517296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.517574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.517856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.518914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.519189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.536973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.537257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.537496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.537788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.537979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.538124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.538429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.538647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.545490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.546317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.547169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.547447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.548006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.548246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.550612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.550895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.551171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.551442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.551650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.551809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.551945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.551945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.552230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.552547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.564853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.565332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.565524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.565688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.565856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.565991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.566123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.566286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.567661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.567957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.568150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.568293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.568425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.568558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.585911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.586163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.589143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.589340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.592377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.592578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.697145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.698832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.699113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.699343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.700376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.702029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.702305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.702602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.706549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.708127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.709714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.711363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.711757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.712045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.712328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.712602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.714685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.714964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.715235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.715503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.721504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.721800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.722093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.724373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.724657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.724938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.729814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79875) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.730028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.730412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.730681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.730953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.731221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.731470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.731766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.732032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.732301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.732532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.732698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 20 16:03:32.732848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.732982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79875) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.733954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.734228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.734478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.734767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.735031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.735292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.735549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.735807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.736061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 20 16:03:32.770307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4a55159c0 pid: 79875 (default app) Mar 20 16:03:32.773802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d98c0-4b11-46fc-84f4-2ba8dda88d20 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:32.773992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4a55159c0 pid: 79876 (default app) Mar 20 16:03:32.774079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d98c0-4b11-46fc-84f4-2ba8dda88d20 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:32.774371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d98c0-4b11-46fc-84f4-2ba8dda88d20 None None] PATH_INFO: `/v3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:32.778523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sun Mar 20 16:03:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:41.019332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:41.019940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:41.019940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:41.024887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:41.030391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:41.030853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:41.031038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:41.062752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG oslo_db.sqlalchemy.engines [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 20 16:03:41.248879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG passlib.handlers.bcrypt [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79875) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 20 16:03:41.249294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG passlib.handlers.bcrypt [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79875) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 20 16:03:41.304918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:41.306537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:41.430864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 20 16:03:41.573246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:41.614687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG oslo_db.sqlalchemy.engines [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 20 16:03:41.753512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e136da7-55ba-46f0-b44e-638e2a71c88a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:41.758971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:41.759624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:41.759906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:41.760175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:41.769263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:41.818776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 20 16:03:41.819115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f9f1-ff9f-4440-807f-474767eb9b65 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:41.832522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sun Mar 20 16:03:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:03:41.839787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:41.862798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af3f93-64ae-4b8b-b1e4-d2260b6ab8eb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:41.867903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:41.869023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:41.869304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:41.869578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] PATH_INFO: `/v3/projects/c02cce03c9e142bab39baeb17444c822` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:41.871127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] RBAC: Authorizing `identity:get_project(project_id=c02cce03c9e142bab39baeb17444c822)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:41.921631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 20 16:03:41.921975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04bcc-7ddc-4289-b7c5-48029a6a199f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:41.926642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Mar 20 16:03:41 2022] GET /identity/v3/projects/c02cce03c9e142bab39baeb17444c822 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:44.167282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9806-4717-409d-8ba5-8dd98d6dfda1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:44.167849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9806-4717-409d-8ba5-8dd98d6dfda1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:44.167849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9806-4717-409d-8ba5-8dd98d6dfda1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:44.172373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:44.178991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:44.179700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:44.179866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:44.204267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:44.205807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:44.214831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 20 16:03:44.238421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9806-4717-409d-8ba5-8dd98d6dfda1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:44.257672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9806-4717-409d-8ba5-8dd98d6dfda1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:44.263212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:44.263847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:44.264126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:44.264396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:44.272181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:44.273942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab301b-ba7d-4e59-a71d-f7df346149fa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:44.282398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sun Mar 20 16:03:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:03:44.288185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:44.297888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ab2a-41fd-4b5c-92e2-ccff08f4de99 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:44.303944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:44.304815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:44.305092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:44.305361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:44.307012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:44.308861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd053d-9104-47e3-bb4b-5d1464f3e0aa admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:44.310439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sun Mar 20 16:03:44 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:46.614173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480d88-3aee-4432-b239-97ab1dbd85b1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:46.614753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480d88-3aee-4432-b239-97ab1dbd85b1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:46.614753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480d88-3aee-4432-b239-97ab1dbd85b1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:46.616500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:46.621698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:46.622131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:46.622380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:46.639346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:46.640485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:46.671995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc79-a329-4a7e-b413-76b0616143c4 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:46.672274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc79-a329-4a7e-b413-76b0616143c4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:46.672551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc79-a329-4a7e-b413-76b0616143c4 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:46.674288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:46.679433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31395307-2307-44de-aa6b-374774243fa4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:46.679714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31395307-2307-44de-aa6b-374774243fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:46.679988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31395307-2307-44de-aa6b-374774243fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:46.720037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG passlib.handlers.bcrypt [None req-31395307-2307-44de-aa6b-374774243fa4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79876) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 20 16:03:46.720460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG passlib.handlers.bcrypt [None req-31395307-2307-44de-aa6b-374774243fa4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79876) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 20 16:03:46.720623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:03:46.747682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:46.766718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-31395307-2307-44de-aa6b-374774243fa4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:46.768309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-31395307-2307-44de-aa6b-374774243fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:46.851307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad079-6764-43ad-a4a5-b145bfb009f4 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:46.875757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:46.884881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:46.885682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:46.885962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:46.886235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:46.897348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:03:46.902502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31395307-2307-44de-aa6b-374774243fa4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:46.904325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:03:46.905715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:03:46.911310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.010736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9844c-2190-4d06-ae53-a38b08b206c4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.010941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31395307-2307-44de-aa6b-374774243fa4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.043139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.043796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.044076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.044350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.045096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:47.045398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.045775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.046687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.046792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.046971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.047243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.057682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:47.063256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.110960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.112575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.160191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86f280-31d9-4f66-b521-d4305c47d53d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.203353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.204254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.204564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.204804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.206190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.207886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.210292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:03:47 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:47.215640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:03:47.217429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.221421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.314014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce41a7-98e0-4ce7-955e-6724fbba29c3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.317373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b110a-0fea-4ac5-a0da-45ba7fd787d2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.347387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.348208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.348485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.348746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.349952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.350050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.350898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.351173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.351446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.351540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.353275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:47.358967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.369919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.371456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.388115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:03:47.389483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:03:47.395055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:47.452840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710165e3-4925-4fc9-9605-8a99594da0cc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.483936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.484557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.484838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.485113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.485938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.domain.id=default, user.id=4122efe2c30943a090f74e733d8eea83) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:47.486242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.487763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e5367-393b-4dad-9877-be93a7a48b28 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.490428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b559-2b70-45a1-bc9d-6d1c22bd2f1c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:47.494708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Sun Mar 20 16:03:47 2022] GET /identity/v3/role_assignments?user.id=4122efe2c30943a090f74e733d8eea83&scope.domain.id=default&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:47.525052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:47.525745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:47.526028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:47.526304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:47.527086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:47.527395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:47.528840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7b69-6854-4a69-9aa0-b5e50890ae2b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:47.548682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:50.197744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f9fc-f83f-4a1b-92c7-8aac4a52d735 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.198309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f9fc-f83f-4a1b-92c7-8aac4a52d735 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.198309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f9fc-f83f-4a1b-92c7-8aac4a52d735 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.200655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:50.212436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45088-b6fc-4534-9fe0-c261f3fab2b4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.213338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45088-b6fc-4534-9fe0-c261f3fab2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.213764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45088-b6fc-4534-9fe0-c261f3fab2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.233817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbeb5d-cfa4-4d32-953c-e29ff742ffee None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.234103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbeb5d-cfa4-4d32-953c-e29ff742ffee None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.234416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbeb5d-cfa4-4d32-953c-e29ff742ffee None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.236460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:50.246183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-72c45088-b6fc-4534-9fe0-c261f3fab2b4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:50.247591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-72c45088-b6fc-4534-9fe0-c261f3fab2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:50.254844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.255129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.255406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.287301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:50.288487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:50.340654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:50.342377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44cc0c-046b-41a4-84ab-c34aff8de836 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.342867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44cc0c-046b-41a4-84ab-c34aff8de836 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.343337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44cc0c-046b-41a4-84ab-c34aff8de836 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.345455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 12/25] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:50.355595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.356170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.356642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.365187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 14/26] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:50.376959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:50.383279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:50.384448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:50.472311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ba0e-2595-45f1-8943-a1411481be1a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:50.489195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:03:50.495227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:50.543080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:50.543894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.544168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.544440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.571350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:03:50.578708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:03:50.579987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 15/28] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:03:50.580788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:50.646963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6ed42-e951-43fb-a369-639d8b9883dc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:50.686035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:50.686821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.687105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.687377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.688177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:50.689632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:50.785222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39d4a-80ab-4112-aad0-f604f707bde8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:50.821224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 14/29] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Mar 20 16:03:50 2022] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:03:50.822637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:50.850357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:50.851168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:50.851447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:50.851722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:50.869162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:50.871701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:50.905484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:03:50.915597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 16/30] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:03:50.919928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.022624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e46f00-ce88-4ab5-b6b1-701d9b934e89 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.054680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaeb1d-9199-4bc7-ade0-7ae9a7f8bd71 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.063015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.063718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.064000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.064273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.065050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:51.065413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.067000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.088072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:51.089891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.090768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.091186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.091598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.092502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:51.093130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.093715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.094876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.113932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:51.123344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.258842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424f5d-dfd8-4eb2-b09b-66f316b1be4a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.274064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471da9-8c5f-4010-bd32-cb4919a474f1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.294894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.295717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.295998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.296269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.297002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.298553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b402c2-11db-4b39-bd61-a6b345506d6d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.313471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.314326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.314630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.314899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.316774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.318307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3dc3e-bb31-4f96-84cb-33283421e4df None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.320670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:03:51 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:51.322122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a0d5-2488-4d28-b9b4-2ad0d68456f9 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.322475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a0d5-2488-4d28-b9b4-2ad0d68456f9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.322758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a0d5-2488-4d28-b9b4-2ad0d68456f9 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.324790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 17/34] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:51.329343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966a0d5-2488-4d28-b9b4-2ad0d68456f9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.438314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966a0d5-2488-4d28-b9b4-2ad0d68456f9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.450496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:03:51 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:03:51.452083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.452377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.452656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.471946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:51.473501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:51.479011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.479930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.480257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.480619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.482596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.484637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.487445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:51.493290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.547680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:51.587025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:51.597672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454708-0e04-4ed2-bc0e-9a01fec89f46 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.632976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.633873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.634164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.634479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] PATH_INFO: `/v3/domains/default/users/4122efe2c30943a090f74e733d8eea83/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.636632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4122efe2c30943a090f74e733d8eea83, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.638154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba134e4-4dc0-4379-a2f7-eb4932002cbc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.661376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1361 bytes} [Sun Mar 20 16:03:51 2022] PUT /identity/v3/domains/default/users/4122efe2c30943a090f74e733d8eea83/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:03:51.752275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2989019-6677-41fc-9292-bc24eaee9787 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:51.787604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344026ba-04c0-42b4-895e-12a1a0f9143a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.787922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344026ba-04c0-42b4-895e-12a1a0f9143a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.788173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344026ba-04c0-42b4-895e-12a1a0f9143a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.788793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:51.789478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.789759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.790033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.790314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:51.790838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:51.792376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:51.798843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030353-2976-4343-80ae-78e8c3a55b68 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:51.799135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030353-2976-4343-80ae-78e8c3a55b68 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:51.799630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030353-2976-4343-80ae-78e8c3a55b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:51.810932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Mar 20 16:03:51 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:03:51.822735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e4030353-2976-4343-80ae-78e8c3a55b68 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:51.824400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e4030353-2976-4343-80ae-78e8c3a55b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:51.909662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 21/41] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:51.937980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:52.049725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf715e0-275e-4b8f-8e21-59bb2a52ece0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:52.080439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6cdb-4403-46d6-ab83-b028b25ea2f1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:52.081088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6cdb-4403-46d6-ab83-b028b25ea2f1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:52.081377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6cdb-4403-46d6-ab83-b028b25ea2f1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:52.083651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 22/42] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:03:52.087034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:52.087867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:52.088187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:52.088899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:52.089957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:52.090160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:52.090564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:52.090938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:52.091707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:52.109121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 21/43] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Mar 20 16:03:51 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:03:52.110720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:52.111926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:52.184174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 23/44] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:52.208702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:52.312669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14dc16-9a1f-4350-a86c-44483f3ad52a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:52.347559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:52.348388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:52.348676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:52.348950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:52.350138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:52.351682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a5b3f-375c-44ba-b02f-63449989dea4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:52.353343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:52.359072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:52.452344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14599-9e0b-4314-bb05-5e9fd475c516 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:52.485954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:52.486649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:52.486929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:52.487198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:52.487929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:52.489842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772fc2-a876-4e19-9e11-3e118e4a151a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:52.518226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:03:52 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:03:54.027788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae21f0-e48f-4e89-8913-6e63114e9800 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.028349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae21f0-e48f-4e89-8913-6e63114e9800 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.028349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae21f0-e48f-4e89-8913-6e63114e9800 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.030104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:54.035469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.035885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.036036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.052966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:54.054121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:54.119307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:54.142225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae21f0-e48f-4e89-8913-6e63114e9800 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:54.245258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae21f0-e48f-4e89-8913-6e63114e9800 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:54.278314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:54.279020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.279296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.279569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.289851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:03:54.296697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:03:54.297895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:03:54.303709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:54.399689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2441-3d65-4d8d-8cf5-c28cb76d9f34 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:54.434216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:54.435010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.435288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.435554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.436314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:54.436614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:54.438038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:54.447422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:54.453115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:54.551892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd344e-7bc9-4696-8d76-46d11abce8d1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:54.584493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:54.585367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.585641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.585885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.587158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:54.588663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:54.590197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:54.595816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:54.693613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8daf0a-406a-4ed3-ba7c-df96719d94cf None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:54.726472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:54.727269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.727537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.727837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.729036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:54.730526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb0cf-6ece-468d-baf8-afa3a95575d3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:54.732119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:54.737988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:54.785436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1705e0-3397-4ad9-be72-5b99a5c206d5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.785721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1705e0-3397-4ad9-be72-5b99a5c206d5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.785995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1705e0-3397-4ad9-be72-5b99a5c206d5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.787987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 28/53] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:03:54.792601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.792943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.793159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.809421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:54.810561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:54.840374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd0ae-2f69-4c39-9729-d6b82220cff9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:54.874082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 29/54] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:03:54.874225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:54.874876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:54.875159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:54.875435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:54.876266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.domain.id=default, user.id=4122efe2c30943a090f74e733d8eea83) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:03:54.876577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:54.878066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:54.884014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 26/55] 10.222.0.18 () {56 vars in 1322 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/role_assignments?user.id=4122efe2c30943a090f74e733d8eea83&scope.domain.id=default&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:03:54.897781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:55.001820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e585f-efd7-4412-ad30-49de26f938fb None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:55.037806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87035218-5968-4051-b376-db41c359e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:55.038636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87035218-5968-4051-b376-db41c359e743 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:55.038927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87035218-5968-4051-b376-db41c359e743 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:55.039176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87035218-5968-4051-b376-db41c359e743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:55.040400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87035218-5968-4051-b376-db41c359e743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:55.041861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87035218-5968-4051-b376-db41c359e743 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:55.043540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 30/56] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:55.049481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:55.149961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09241eb-208e-4d30-8951-d3924fa9bf48 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:55.181254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:55.182025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:55.182354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:55.182637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:55.183370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:55.184821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877d76-01a0-422e-8ade-c06ee81e63d4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:55.217617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 27/57] 10.222.0.18 () {60 vars in 1140 bytes} [Sun Mar 20 16:03:55 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:03:57.478184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789e7-537c-41bd-a374-58ebd7e2725b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:57.479051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789e7-537c-41bd-a374-58ebd7e2725b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:57.479051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789e7-537c-41bd-a374-58ebd7e2725b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:57.481882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:03:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:03:57.487330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:57.487740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:57.487898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:57.506587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:03:57.507750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:03:57.576720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:03:57.601635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac789e7-537c-41bd-a374-58ebd7e2725b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:57.702632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac789e7-537c-41bd-a374-58ebd7e2725b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:57.736258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:57.736981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:57.737264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:57.737535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:57.739198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:57.740644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc996-9dbc-4a59-a4e9-46277491ba15 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:57.742228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:03:57.747802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:03:57.848769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b6db-6291-48df-ab88-bc127c282b98 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:03:57.882114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:03:57.882798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:03:57.883083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:03:57.883304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:03:57.884041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:03:57.885488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747d16-1fe2-406d-b6c0-36656a227947 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:03:57.915612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:03:57 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:01.396629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e012-fa88-4d1e-8ffc-faafa5a108e3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.397646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e012-fa88-4d1e-8ffc-faafa5a108e3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.398125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e012-fa88-4d1e-8ffc-faafa5a108e3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.400410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:01.405836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac8e7-c9d8-4aad-a0a1-ebad049df1d9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.406706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac8e7-c9d8-4aad-a0a1-ebad049df1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.407176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac8e7-c9d8-4aad-a0a1-ebad049df1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.423449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92530f9b-88ba-44fb-b324-41ce3754586f None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.424064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92530f9b-88ba-44fb-b324-41ce3754586f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.424545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92530f9b-88ba-44fb-b324-41ce3754586f None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.426819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 34/63] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:01.430870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-01cac8e7-c9d8-4aad-a0a1-ebad049df1d9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:01.432338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.432833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.433297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.436447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-01cac8e7-c9d8-4aad-a0a1-ebad049df1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:01.460572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:01.463244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:01.538547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 35/64] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:01.569631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:01.580179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:01.616625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b76bf-7022-4720-a413-42b54e51b87a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.617256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b76bf-7022-4720-a413-42b54e51b87a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.617753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b76bf-7022-4720-a413-42b54e51b87a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.620034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 31/66] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:01.620942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b76bf-7022-4720-a413-42b54e51b87a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:01.673814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac4b8-2e4a-4807-940f-d5617c1963ff None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:01.713498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:01.714621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.715201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.715486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.731730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:01.738866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b76bf-7022-4720-a413-42b54e51b87a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:01.740845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-ed8b1690-f457-41c5-bcf6-709c2906a1fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:01.743280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 36/67] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:01.744384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.744671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.744950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.762686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:01.763906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:01.781369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:01.782481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.783344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.783827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.798326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:01.807017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-da400b82-84d5-45a5-a826-ed2fa42acd99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:01.809188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 32/68] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:01.810969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252df6-d65c-4807-ba22-f3a1e471d98c None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.811720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252df6-d65c-4807-ba22-f3a1e471d98c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.812203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252df6-d65c-4807-ba22-f3a1e471d98c None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.818599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 33/69] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:01.819240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252df6-d65c-4807-ba22-f3a1e471d98c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:01.834613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 37/70] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:01.834613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:01.925636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252df6-d65c-4807-ba22-f3a1e471d98c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:01.939720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd445-2122-4f55-a896-892c3b521d7f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:01.960557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:01.961227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.961498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.961772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.962575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:01.962871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:01.964331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ae13a-5892-4d1e-b437-a5b58a1c88aa None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:01.972389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:01.973972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.974282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.974582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.979718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:01.981062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:01.981062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:01.981062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:01.981678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:01.981980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:01.983403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:01.991762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:01.996579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 38/72] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:01.996696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:01.996770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.062481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 35/73] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:02.063335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.105876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123195-e890-4fed-b6bd-ca3b1221c751 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.137403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.138219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.138535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.138811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.148351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:02.155683 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad916e-983e-4f14-b2cb-847b9f3d72b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.155792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:02.156877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 39/74] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:02.158884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.188408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.189284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.189563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.189839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.191133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.192598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58b3ac-94ec-4590-aed9-600f3b0429d1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.194201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 36/75] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.196496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47896b-91b2-49dc-92ca-09914e5f1195 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.196783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47896b-91b2-49dc-92ca-09914e5f1195 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.197060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47896b-91b2-49dc-92ca-09914e5f1195 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.199728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 37/76] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:02.199728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47896b-91b2-49dc-92ca-09914e5f1195 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.253171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a70c3e-0d29-4925-9764-515f0d23232d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.284775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.285654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.285936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.286279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.297864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47896b-91b2-49dc-92ca-09914e5f1195 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.301063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.302569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.304216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 40/77] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.304973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.331506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.332308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.332591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.332868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.342553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:02.349478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:02.350686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 38/78] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:02.352499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.398132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa4c3c-293d-4269-8496-b143d0a0cca8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.431139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.431806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.432089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.432366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.433109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:02.433422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.434928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23478695-c62e-4ed1-8997-00f5789581a1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.442598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 41/79] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.443721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.444011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.444299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.447945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0e0e-d97a-48b9-82aa-eee4ce4721d9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.460859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:02.462056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:02.479834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.480485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.480765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.481036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.524414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 42/80] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:02.525172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.559910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.561397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.616814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6170-25b1-4503-add9-37f5875f4979 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.648668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.649310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.649577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.649854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.656524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 39/81] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:02.657353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.714670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.716132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.748803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac070-026e-4311-ad4c-28d6a183166e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.783476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.784193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.784473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.784747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.785501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:02.785800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.787381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.796160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 40/82] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.797041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.816854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:02.817704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.895886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f9d-f605-47e8-8b89-73ede744f734 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.917602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a939f1-fe34-4bca-9d4c-e9e60f96a07d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:02.930533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.931422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.931756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.932043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.933247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.934764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.936748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.937636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:02.951734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:02.952541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:02.952825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:02.953099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:02.954283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:02.955753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:02.957849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 44/85] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:02.958627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.038406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7c25-4a60-4e3b-8178-9e5e21797eaa None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.059339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58751-c899-4f6a-844d-089438c45211 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.072390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.073257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.073538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.073815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.075015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.076481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.078182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 42/86] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.078964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.091622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.092505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.092794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.093084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.094294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.095749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.097421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:02 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.098169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.171250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df0343-54a8-477d-bc0e-d027c1bc85cb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.192286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd7-075d-486a-952f-d90eebb261b7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.207167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.208036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.208317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.208582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.209805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.211302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.212985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 43/88] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.213714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.228726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.229390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.229676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.229934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.295995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.297383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.306969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581378-dc4f-40a7-9cdd-3155f8979287 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.339917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.340586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.340868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.341143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.341858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.343323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.362939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 44/89] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:03 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:03.364126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.416454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 46/90] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:03.416454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.469182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56d48-2dc6-4d80-8b8f-ae5c99e6ec3e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.504265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.504982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.505268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.505545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.506429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=4122efe2c30943a090f74e733d8eea83) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:03.506745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.508215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.514209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/role_assignments?user.id=4122efe2c30943a090f74e733d8eea83&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.515092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.525537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfa0a-43aa-4835-ad09-cdf4f8f17447 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.568229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.568827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.569369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.569369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.623377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd4df-6099-42f3-b3cc-7354172343b8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.648977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.650549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.659796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.660798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.661258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.661705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.662788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:03.663313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.665003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.678407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.679727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.758279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 47/93] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:03.763985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.789036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8ff5f-e390-4d53-a548-a4386a2b41a0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.827669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.828827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.829284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.829754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.831309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.833055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.835404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:03.841673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:03.911823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1997-3572-4d1e-a88e-aebcfd6d1fdd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:03.953915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:03.955119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:03.958465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:03.958973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] PATH_INFO: `/v3/projects/c430aeb12cf24f07aad0896f3effc46c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:03.961335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] RBAC: Authorizing `identity:get_project(project_id=c430aeb12cf24f07aad0896f3effc46c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:03.963015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:03.964911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/projects/c430aeb12cf24f07aad0896f3effc46c => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:03.972485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:04.039817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d41a-1c97-4f9d-b530-a762598ebb77 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:04.076031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:04.077252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:04.077770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:04.078222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:04.079269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:04.079755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:04.081437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad938-53f0-4357-8a83-9d31ddcaf4c6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:04.087644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:04.136187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4f2d-b66f-4c15-91a5-a3b8bf53bea9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:04.171984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:04.172957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:04.173413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:04.173856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:04.174953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=c430aeb12cf24f07aad0896f3effc46c, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:04.175459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:04.177144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edeac1-4378-4087-ba6f-a48a4eb66f99 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:04.185867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:03 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=c430aeb12cf24f07aad0896f3effc46c&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:06.696593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f85-8f49-40a6-bcdc-0e7cf7c8f723 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.697608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f85-8f49-40a6-bcdc-0e7cf7c8f723 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.698112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f85-8f49-40a6-bcdc-0e7cf7c8f723 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.700109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:06.705502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e861-f768-4e4e-9712-87fe260f1be4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.706389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e861-f768-4e4e-9712-87fe260f1be4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.706899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e861-f768-4e4e-9712-87fe260f1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.731343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-34e6e861-f768-4e4e-9712-87fe260f1be4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:06.732905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-34e6e861-f768-4e4e-9712-87fe260f1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:06.814996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:06.831418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f17ea-08f3-4c08-8140-c39a4365d024 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.832016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f17ea-08f3-4c08-8140-c39a4365d024 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.832509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f17ea-08f3-4c08-8140-c39a4365d024 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.834555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:06.835740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896c6-14ca-40e7-b331-70c9931c5a61 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.836171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896c6-14ca-40e7-b331-70c9931c5a61 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.836578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896c6-14ca-40e7-b331-70c9931c5a61 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.839291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 51/101] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:06.844846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.845388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.845879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.846894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:06.847313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:06.847721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:06.866754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:06.868304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:06.883288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:06.884883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:06.981428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 51/102] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:06.982207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.043657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 52/103] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:07.044539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.099325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ce69d-1e12-41c9-bea1-09268d3f1c87 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.135519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.136385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.136668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.136944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.148239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:07.156651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:07.157923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:07.158880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.235382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669d38f-8033-4a1e-a3d7-bc98d3b829ca None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.270355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.271167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.271455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.271732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.275709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c6a-6be7-4d9d-9def-dc34291058cf None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.285841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:07.293205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:07.294446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:07.295358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.313098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.314136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.314598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.315067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.325036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:07.332293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-fbdb683f-ef4d-4165-8a40-bdf41e270006 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:07.333548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 53/106] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:07.334754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efdcb-80b8-40ee-bb4a-deadafd4c941 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.335039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efdcb-80b8-40ee-bb4a-deadafd4c941 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.335315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efdcb-80b8-40ee-bb4a-deadafd4c941 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.337181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 54/107] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:07.342010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82408-9b93-4266-bcec-c64a46ed44be None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.342322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82408-9b93-4266-bcec-c64a46ed44be None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.342627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82408-9b93-4266-bcec-c64a46ed44be None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.344229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 55/108] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:07.345057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82408-9b93-4266-bcec-c64a46ed44be None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.408404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8936-f75d-4ba4-bded-5af27302489b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.443822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.444704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.445020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.445403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.445742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82408-9b93-4266-bcec-c64a46ed44be None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.446165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:07.446503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.448918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.457503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 54/109] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.458343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.478476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.479153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.479440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.479721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.480479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:07.480785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.482168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407000-d699-4fe9-b8b3-89b195955bc7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.495368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 56/110] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.495368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30202-5eb8-4e94-b716-6c5fd17e6c86 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.495368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30202-5eb8-4e94-b716-6c5fd17e6c86 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.495368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30202-5eb8-4e94-b716-6c5fd17e6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.508128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a5e30202-5eb8-4e94-b716-6c5fd17e6c86 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:07.509301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a5e30202-5eb8-4e94-b716-6c5fd17e6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:07.568804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488e70-c577-4ab0-97ed-c966d77013c0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.578478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 57/111] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:07.581631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.582155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.582786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.603325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.604011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.604291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.604569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.605329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:07.605637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.607126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.608028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:07.609212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:07.615797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 55/112] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.616611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.675971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 58/113] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:07.676832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.721510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e6e81-6b17-4221-abdd-0e4e181ef6c7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.754658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.755469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.755755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.756034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] PATH_INFO: `/v3/users/1501c8739f2748948a30a3c6dc9496ef` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.769186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] RBAC: Authorizing `identity:get_user(user_id=1501c8739f2748948a30a3c6dc9496ef)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.770701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.772443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 56/114] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/users/1501c8739f2748948a30a3c6dc9496ef => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.777725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.778209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dae94-72ec-4c3a-aa5b-fa1e3a90494c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.812213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.813090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.813365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.813634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.814844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.816338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.817944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 59/115] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.817944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.876541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2b73a-d4ca-492a-9d57-116807ecbc0c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.907983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.908970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.909099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.909402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.910689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.912334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.914009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 57/116] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.918669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ddba-5c62-470e-9914-b8da6d075f11 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:07.918801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:07.948182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:07.949064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:07.949346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:07.949620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:07.950870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:07.952336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:07.953922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 60/117] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:07.954704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.011908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411fe13-d38d-44c4-bbc4-806e186ade0d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.043255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.044060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.044341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.044618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.046548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912d16-08a7-4e74-a355-bf2cfcaf1496 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.054360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:08.061675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:08.062864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 58/118] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:08.063618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.079363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.080017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.080298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.080578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.144611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.146075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.159073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faaf39-2c3b-4ef4-abf6-9d4299785293 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.190854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.191719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.192056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.192331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.193543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.195053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee00df5-97cf-487c-a4da-58e7b1236cdb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.196886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 59/119] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:08.197843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4e87-0f5c-41d6-ad78-58ed50ef44a9 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.198140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4e87-0f5c-41d6-ad78-58ed50ef44a9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.198445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db4e87-0f5c-41d6-ad78-58ed50ef44a9 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.200040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 60/120] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:08.204841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db4e87-0f5c-41d6-ad78-58ed50ef44a9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.243707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:08.244762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.299380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db4e87-0f5c-41d6-ad78-58ed50ef44a9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.331668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.332336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.332628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.332905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.333612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.334602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17c069-61d4-4592-83a1-efcbac3bb36a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.335113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.361613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 61/122] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:04:08 2022] POST /identity/v3/projects => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:08.362464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.373780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.375047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.375315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.375675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.377038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.378713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.380558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:08.381502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.480984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b5125-3008-4ba5-8f3f-be7f881991f5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.489372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282505-28bc-41fe-a211-a1aab6a5ad16 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.515900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.516587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.516874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.517150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.517912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:08.518220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.519762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456114-e594-4628-9720-80670e36cc05 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.523317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.524224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.524501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.524772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/4122efe2c30943a090f74e733d8eea83/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.526804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, user_id=4122efe2c30943a090f74e733d8eea83, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.533312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.533480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:08.533480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.533480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.533480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.547570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 63/125] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:08 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/4122efe2c30943a090f74e733d8eea83/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:08.554539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.554665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:08.554665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:08.640815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 63/126] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:08.642086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.684501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea241bf2-fa79-4ff2-b7ad-52a419631448 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.722274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.723227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.723517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.723792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.725054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.727030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.728665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:08.729575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.762753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7159-8a16-48aa-bc00-f1cc2c104567 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.806993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.807978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.808098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.808380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/8a9da56ceac14294a15bbd4a29f97677/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.810426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, user_id=8a9da56ceac14294a15bbd4a29f97677, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.811902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.828851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 64/128] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:08 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/8a9da56ceac14294a15bbd4a29f97677/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:08.831108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.841942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f695c-ef12-4c56-bbf3-dcca87ca8274 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.886080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.887206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.887493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.887771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.889830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:08.891543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:08.893920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:08.894879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:08.946148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9d5e5-6592-4b82-8ad0-148ae339f804 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:08.981556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:08.982799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:08.983284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:08.983777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:08.995626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:09.003456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:09.005241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:09.006289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.022793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e1cb7-3ff3-40d9-ae99-e6d9c6ae7e2e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.057952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.058989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.059491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.059981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.061022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=1501c8739f2748948a30a3c6dc9496ef) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:09.061552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.063266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.069489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:08 2022] GET /identity/v3/role_assignments?user.id=1501c8739f2748948a30a3c6dc9496ef&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=11d741f5bead46dd867e05f4fec25133 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:09.070655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.117299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b929-01a8-43a7-a451-c3a58aea8648 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.152792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.153657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.153940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.154234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.155576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.157162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.158966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:09 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:09.167397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.192030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfd74-7077-486f-ac09-87a28052e63e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.237155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.238034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.238763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.239109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.240044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:09.240392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.241906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.252253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:09.257041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.302057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f901bb5-5c53-4047-9749-519e17a3f357 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.345979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.346906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.347793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.348091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/8a9da56ceac14294a15bbd4a29f97677/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.350418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, user_id=8a9da56ceac14294a15bbd4a29f97677, role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.352276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.370101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 67/134] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:09 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/8a9da56ceac14294a15bbd4a29f97677/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:09.408673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28aa2-3eaa-40ac-a034-634f65398bdb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.467796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.469123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.469628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.470106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.471913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.473656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.475686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 68/135] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:09 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:09.481571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.618652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0e54-b0e9-4a77-81df-adbdaf3e9fb1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.662063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.663435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.663923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.664382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] PATH_INFO: `/v3/projects/c430aeb12cf24f07aad0896f3effc46c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.666371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] RBAC: Authorizing `identity:get_project(project_id=c430aeb12cf24f07aad0896f3effc46c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.667867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6774e-11c1-4147-865e-6a7ea750cc1f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.669695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:09 2022] GET /identity/v3/projects/c430aeb12cf24f07aad0896f3effc46c => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:09.675845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:09.806686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2f53-11d4-4d32-bd96-440d3a87f90f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:09.840004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:09.840921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:09.841208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:09.841486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] PATH_INFO: `/v3/projects/c430aeb12cf24f07aad0896f3effc46c/users/8a9da56ceac14294a15bbd4a29f97677/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:09.843514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] RBAC: Authorizing `identity:create_grant(project_id=c430aeb12cf24f07aad0896f3effc46c, user_id=8a9da56ceac14294a15bbd4a29f97677, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:09.844987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ccc8-1683-42bb-89c1-31d07a164111 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:09.860290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:09 2022] PUT /identity/v3/projects/c430aeb12cf24f07aad0896f3effc46c/users/8a9da56ceac14294a15bbd4a29f97677/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:11.318531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4392db-7dc8-459e-95de-2e23440148e7 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.319048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4392db-7dc8-459e-95de-2e23440148e7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.319120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4392db-7dc8-459e-95de-2e23440148e7 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.320938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 69/138] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:11.327699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.328243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.328722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.348990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:11.350179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:11.428521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:11.467761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4392db-7dc8-459e-95de-2e23440148e7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:11.585390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4392db-7dc8-459e-95de-2e23440148e7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:11.619421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:11.620235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.620521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.620802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.621974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:11.623468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af38d-6e31-419b-85f4-519ba8ad233d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:11.625082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:11.630546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:11.772195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7966-2d93-4caf-b8ab-d1cd4926607d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:11.809370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:11.809370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.809370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.809370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.809785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:11.810928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6d0d-0091-4074-9fff-eeae47d213b9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:11.842373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 71/141] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:11 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:11.919656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c01b-a5e1-4b56-a703-82a09b314532 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.920056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c01b-a5e1-4b56-a703-82a09b314532 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.920208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c01b-a5e1-4b56-a703-82a09b314532 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.922005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 71/142] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:11.928011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:11.928290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:11.928654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:11.951938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:11.952651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:12.050393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 72/143] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:12.092330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c01b-a5e1-4b56-a703-82a09b314532 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:12.212657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c01b-a5e1-4b56-a703-82a09b314532 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:12.247599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:12.248419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.248703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.248980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.260360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:12.267480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:12.269143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:12.274911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:12.383605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe00f-1071-42d5-a526-0ca26aa38734 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:12.419442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:12.420259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.420547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.420830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.421694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:12.421956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:12.423391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:12.435375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 73/145] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:12.438860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:12.557852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c6c7-5811-45d3-8db8-21da09f1eff7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:12.591258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:12.592232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.592522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.592802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] PATH_INFO: `/v3/users/4122efe2c30943a090f74e733d8eea83` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.594016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] RBAC: Authorizing `identity:get_user(user_id=4122efe2c30943a090f74e733d8eea83)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:12.595509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6a1e2-c248-4286-9ecb-f8e56c663045 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:12.597182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 73/146] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:12 2022] GET /identity/v3/users/4122efe2c30943a090f74e733d8eea83 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:12.602922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:12.642854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad6bc-cb1e-4293-98e6-712ef94e8f1d None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.643510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad6bc-cb1e-4293-98e6-712ef94e8f1d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.643981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad6bc-cb1e-4293-98e6-712ef94e8f1d None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.645954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 74/147] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:12.653308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.653897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.654422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.691318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:12.692857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:12.724963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612aabc-8a8d-40e6-939c-996dce94e80c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:12.763644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:12.764317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.764602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.764882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.822348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:12.833587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:12.835194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150df7c8-690a-4575-a6a2-9ca3b5f89fd6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:12.845044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:12.940062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 74/149] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:12.941471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9643b-3621-4c17-b737-b8753a4b22e0 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.941765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9643b-3621-4c17-b737-b8753a4b22e0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.942044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9643b-3621-4c17-b737-b8753a4b22e0 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.944117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 75/150] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:12.947557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c11557-444d-4556-9a70-1c4be0e04262 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:12.949216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.949513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.949791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.966509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:12.967764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:12.983092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:12.983906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:12.984206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:12.984459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:12.995387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:13.003326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:13.004548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:13.005360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.037405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 76/152] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:13.038396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.108333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1028-7ecd-4fa7-a6a8-a8191cf694e5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.141312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.142204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.142513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.142785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.143199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405567d-0db8-429d-88f5-e11166fa428d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.144188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.145685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe063-301f-40bc-a36d-58a5a9e9dc69 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.147529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.148805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fa42-4712-4a17-be82-054200e059af None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.149092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fa42-4712-4a17-be82-054200e059af None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.149362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fa42-4712-4a17-be82-054200e059af None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.151177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 78/154] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:13.151705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69fa42-4712-4a17-be82-054200e059af None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.193544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.194278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.194583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.194854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.195621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:13.195922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.197328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.214644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.214644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.260279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69fa42-4712-4a17-be82-054200e059af None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.304890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.305732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.306017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.306368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.320772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:13.323881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcaabb-0fc9-4e79-a0d0-4fa0eb9b55f0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.329128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5f02a460-fe33-4442-97d5-6ce7ffbe6982 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:13.334361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:13.335637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.335926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.336208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.356744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:13.358497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:13.364262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.364930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.365203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.365472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.366323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=4122efe2c30943a090f74e733d8eea83) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:13.367052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.368866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.376202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/role_assignments?user.id=4122efe2c30943a090f74e733d8eea83&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.376988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.457393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 80/158] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:13.458201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.526224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4db1a-6b1f-4a44-af1f-487f0949a30a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.580365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847dad-ded6-4826-bdb9-f87492b71a8d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.603089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.604025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.604357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.604579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.605980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.607521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.609461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 79/159] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.610056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.621036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.622206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.622694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.623201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.624872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:13.625372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.627182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.637627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 81/160] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.640449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.737706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bf42e-953a-4967-bde3-fb02ef426889 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.749672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3368a66-4303-40b8-952f-2c71932fb4f2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.778356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638441-098e-408d-97df-caef427f96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.779181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638441-098e-408d-97df-caef427f96f0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.779459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638441-098e-408d-97df-caef427f96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.779725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638441-098e-408d-97df-caef427f96f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.784644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.785310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.785586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.785855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.794622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42638441-098e-408d-97df-caef427f96f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:13.801688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-42638441-098e-408d-97df-caef427f96f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:13.803177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:13.803737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638441-098e-408d-97df-caef427f96f0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.855656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.857139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b27b3a-e8e6-4287-8a4f-7e386c641bce None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.927743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638441-098e-408d-97df-caef427f96f0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:13.960932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 82/162] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:13.962378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035b70-600c-471b-a74b-cad403411df4 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.962672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035b70-600c-471b-a74b-cad403411df4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.962947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035b70-600c-471b-a74b-cad403411df4 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.964657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 83/163] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:13.965379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035b70-600c-471b-a74b-cad403411df4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:13.977841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:13.978778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:13.979432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:13.979709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:13.981897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:13.983923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:13.989985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 81/164] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:13.990816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.132037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035b70-600c-471b-a74b-cad403411df4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.153719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74467-4981-4228-a8b4-49c084a26ec7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.186640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.187514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.187791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.188063 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.189257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.190817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325aed1-5bf0-4d51-b571-455589663a66 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.192509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 82/165] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:14.193634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.193912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.194188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.214956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.215642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.215914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:14.216101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.216244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.216926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:14.217092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:14.217232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.218615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.240771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:14.241531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.294305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 83/167] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:14.294937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.391214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968044f5-d59b-4bbf-ad1e-2cd389c0bd49 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.424697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.425358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.425634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.425908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.426772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:14.427076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.428526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.434838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:14.435432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.533980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15d531-5b7c-47af-b2d8-8f64809bb369 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.536009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43efce-10d6-4be7-af73-0c1ee8e423ef None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.570675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.571566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.571846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.572114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] PATH_INFO: `/v3/users/1501c8739f2748948a30a3c6dc9496ef` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.573357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=1501c8739f2748948a30a3c6dc9496ef)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.574850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.576739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/users/1501c8739f2748948a30a3c6dc9496ef => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:14.577309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.622988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.623656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.623933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.624203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.682910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90765c-91e9-43eb-9469-a67dab722ea9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.717729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.718581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.718887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.719663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.730613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:14.737836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:14.739662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 86/170] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:14.740229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.781848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.783362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.863792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a028d3-628a-4f40-af89-c959721220fa None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:14.902663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:14.903839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:14.904123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:14.904396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:14.905598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:14.909023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:14.909152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:14.909860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:14.978654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 85/172] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:14.979506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.096900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0967e8c-77c9-41a9-b464-12e7c7e77f84 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.145365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135ec0-de7a-437d-8216-2f1f6c8f42a6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.183012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.183890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.184171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.184454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.185318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:15.185569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.185693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.186527 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.186807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.187045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.187153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/1501c8739f2748948a30a3c6dc9496ef/roles/11d741f5bead46dd867e05f4fec25133` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.189041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, user_id=1501c8739f2748948a30a3c6dc9496ef, role_id=11d741f5bead46dd867e05f4fec25133)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.190577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.212106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:15.212481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 86/174] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:14 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/users/1501c8739f2748948a30a3c6dc9496ef/roles/11d741f5bead46dd867e05f4fec25133 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:15.212758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.224470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.370552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e6f4-9849-4852-9613-7946a1659ea1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.416303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.417316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.417597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.417867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] PATH_INFO: `/v3/users/8a9da56ceac14294a15bbd4a29f97677` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.419482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9da56ceac14294a15bbd4a29f97677)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.421268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.423230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 87/175] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:15 2022] GET /identity/v3/users/8a9da56ceac14294a15bbd4a29f97677 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:15.429323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.512513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e5a6-f951-4de7-b73a-ea1b45378d72 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.551933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.552816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.553093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.553362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.555217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.556672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.558582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 89/176] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:15 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:15.570273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.620313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659d93-5979-43ff-9523-f127c8e1c934 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.672880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f2ec-d270-429e-9cd0-4b668510a5d4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:15.673058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.673587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.673871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.674141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.706729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:15.707624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.708051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.708568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.709542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:15.709994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.711611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.717722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:15 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:15.773538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:15.775073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a2880-97d2-4233-b81a-3bfd5ddf09b8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:15.888736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:15.894202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:15.983279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111142-473e-4f07-99e4-8e5f3eb80a91 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.983647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111142-473e-4f07-99e4-8e5f3eb80a91 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.984192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111142-473e-4f07-99e4-8e5f3eb80a91 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:15.986603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 89/179] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:15.993649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:15.994050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:15.994446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.015107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:16.017269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:16.071952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97367-bd0a-4aac-9fc4-38939cf18e41 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.091995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 90/180] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:16.118038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.167118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.168272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.168700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.169112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] PATH_INFO: `/v3/projects/c430aeb12cf24f07aad0896f3effc46c` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.170699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] RBAC: Authorizing `identity:get_project(project_id=c430aeb12cf24f07aad0896f3effc46c)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:16.172337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:16.174370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 91/181] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:15 2022] GET /identity/v3/projects/c430aeb12cf24f07aad0896f3effc46c => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:16.180625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.243339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd24872-f312-4dbf-9053-8c44bb7d7a1d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.277904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.279103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.279576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.280036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.299735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:16.310984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:16.313752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:16.326293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.381121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871616fa-2f53-4aa4-8350-5caf615641d1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.439402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806e2f-1eed-499f-9f93-a369221da81a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.439587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.440258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.440546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.440825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.441668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=c430aeb12cf24f07aad0896f3effc46c, user.id=8a9da56ceac14294a15bbd4a29f97677) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:16.441986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:16.443736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:16.449568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/role_assignments?user.id=8a9da56ceac14294a15bbd4a29f97677&scope.project.id=c430aeb12cf24f07aad0896f3effc46c&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:16.475999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.477167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.477639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.478113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.479237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:16.479755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:16.481503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ef66-8f3f-496d-a20e-abaaeeb79b36 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:16.491794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 92/184] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:16.497908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.543065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282258-8312-4855-aecd-3865b27a17e9 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.543675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282258-8312-4855-aecd-3865b27a17e9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.544595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282258-8312-4855-aecd-3865b27a17e9 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.547001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 93/185] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:16.553343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.553907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.554401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.574367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:16.575913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:16.606857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ae69f-5cdd-400c-b617-8b5a442188fc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.645385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 94/186] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:16.650335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.650335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.652035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.652035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.679168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:16.680684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:16.682501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:16.688359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.693029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.790161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c402884-2115-476f-a8b3-eb316260e9b9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.819112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6f77-6a17-457f-8dbc-688758ee5cb0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.825280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.826193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.826696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.827173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.859630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:16.860453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.860731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.861000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.877360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:16.886311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-930365e3-8fd1-43ed-af2e-ae20af2652f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:16.887572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:16.888783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07c87-3679-4b10-8923-5726e70ebf37 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:16.889068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07c87-3679-4b10-8923-5726e70ebf37 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:16.889340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07c87-3679-4b10-8923-5726e70ebf37 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:16.891033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 95/189] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:16.893408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c07c87-3679-4b10-8923-5726e70ebf37 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:16.905672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:16.907202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca98a4f-e9da-4b5d-af4e-562e732bbf9c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:16.990724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c07c87-3679-4b10-8923-5726e70ebf37 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:16.999798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 95/190] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:17.001053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.001344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.001621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.017616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:17.018859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:17.027269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.027941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.028217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.028491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.029246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:17.029549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.030961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.042929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.042929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.089938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 96/192] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:17.094483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.152770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b165a-49b5-4d36-a958-ffb63419a81d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.194080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.195225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.195676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.196104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.196261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373da0d-65c1-4a39-8bb9-80aea6fbb177 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.197580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.199047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.200736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 97/193] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.206319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.237361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.238579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.238858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.239133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.240321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.241779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.247901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.247901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.310868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c79b-aa3b-4111-867f-0a6ccfa828d6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.340742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1d47-f8b1-42e6-8a44-3566bce79d52 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.342946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.343748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.344029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.344303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.345480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.347037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.348825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.349419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.375633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.376637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.377132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.377656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.378618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=6252b9ded0b94ddb87e42eed2cd52018) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:17.378935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.380390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.385677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/role_assignments?user.id=6252b9ded0b94ddb87e42eed2cd52018&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.386462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.468797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b0d5-ccc2-4639-bba2-4579d03aa9ba None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.504962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122caf-c8ac-408d-be11-21bc15c013f5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.507118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.507977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.508475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.509051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.542008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.542829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.543113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.543386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.544328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.545600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.576380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 99/197] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:17 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:17.585961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.587517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.696723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:17.703520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.804159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d44bf-a317-4a98-afe1-a7156da00235 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.840522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.841312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.841585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.841856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.843141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.844583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbd028-8ecf-4022-a5f2-56a8cfd4f730 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.846675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:17.852473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:17.950722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d21955-8a2d-453a-9ee4-c4028f030959 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:17.984379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:17.985326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:17.985801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:17.986282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:17.987308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=6252b9ded0b94ddb87e42eed2cd52018) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:17.987780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:17.989701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933ee0a-08c7-4156-9bbd-10ab76cdc252 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:17.995834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:17 2022] GET /identity/v3/role_assignments?user.id=6252b9ded0b94ddb87e42eed2cd52018&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:18.065926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01974b-180b-4b2d-9584-234c7cf063f3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.066518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01974b-180b-4b2d-9584-234c7cf063f3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.066986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01974b-180b-4b2d-9584-234c7cf063f3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:18.069276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 101/201] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:18.074494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.074782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.075076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:18.099586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:18.100716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:18.191371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 101/202] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:18.218156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01974b-180b-4b2d-9584-234c7cf063f3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:18.318813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01974b-180b-4b2d-9584-234c7cf063f3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:18.356009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:18.356744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.357024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.357297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:18.371047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:18.378078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:18.379496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:18.385188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:18.509306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89756-c385-4dcd-b58b-2c5a859ad9b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:18.554039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:18.555072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.555539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.556020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:18.556956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:18.557446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:18.559100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:18.574314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:18.579936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:18.705813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39963-5503-43fe-94db-bedd971d1df8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:18.743503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:18.744690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.745155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.745632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] PATH_INFO: `/v3/users/1501c8739f2748948a30a3c6dc9496ef` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:18.747016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] RBAC: Authorizing `identity:get_user(user_id=1501c8739f2748948a30a3c6dc9496ef)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:18.748663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:18.750492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:18 2022] GET /identity/v3/users/1501c8739f2748948a30a3c6dc9496ef => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:18.756214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:18.888084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389280da-26a6-4edc-a8f3-2e31806e7727 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:18.925734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:18.926418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:18.926703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:18.926978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:19.012140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:19.013537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:19.118012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:19.123609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:19.277687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc773-88fd-4152-94ef-5e5bad5d5053 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:19.323880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:19.324763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:19.325043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:19.325317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:19.326544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:19.328027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91fe41-eef9-43cf-b644-0f9abfce587f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:19.329907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:19 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:19.335772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:19.477949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771923a-efe0-4e81-873a-363a665dd14f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:19.511127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:19.511794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:19.512138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:19.512417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:19.513248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230, user.id=1501c8739f2748948a30a3c6dc9496ef) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:19.513559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:19.515039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1057539-2fd6-444e-996b-468eaded1f7b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:19.520932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:19 2022] GET /identity/v3/role_assignments?user.id=1501c8739f2748948a30a3c6dc9496ef&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=11d741f5bead46dd867e05f4fec25133 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:20.034187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4a39-a0ab-4d4f-8238-d9fdeb10cec3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.034725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4a39-a0ab-4d4f-8238-d9fdeb10cec3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.034830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4a39-a0ab-4d4f-8238-d9fdeb10cec3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.036622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:20.042510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.043016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.043086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.066778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:20.067976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:20.143575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:20.166551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4a39-a0ab-4d4f-8238-d9fdeb10cec3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.268403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4a39-a0ab-4d4f-8238-d9fdeb10cec3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.301306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.302038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.302341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.302613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.312525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:20.319731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f7955c9a-8e00-49f7-bc12-3223d50bc259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:20.321261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 106/211] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:20.326968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.427293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1587a-eb30-48c5-91b8-918e828138c9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.451863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2ddd9-3995-460a-8ae5-083b10892b8c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.452499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2ddd9-3995-460a-8ae5-083b10892b8c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.452988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2ddd9-3995-460a-8ae5-083b10892b8c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.459150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 107/212] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:20.460925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.461449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.461916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.464742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.465418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.465701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.465980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.466767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:20.467070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:20.468548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:20.477144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:20.481299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:20.482766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.483285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:20.557945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 108/214] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:20.580784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.587243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50f8c3-d4c8-4501-8eb8-9a00395a8848 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.620715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.621707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.621992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.622280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.623511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:20.624972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:20.631301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:20.632170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.693647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c38d1-363d-4786-baa3-09867bdb0c03 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.733301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.734111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.734440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.734714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.748247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f1b5-efa6-4642-9406-7744e6658c23 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.748447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:20.756897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5f87d480-6455-403d-b487-1b6fc458895f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:20.759209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:20.760827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1858da-cf2f-4772-bd0c-1022fb7c45ae None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.761260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1858da-cf2f-4772-bd0c-1022fb7c45ae None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.761537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1858da-cf2f-4772-bd0c-1022fb7c45ae None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.764166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 110/217] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:20.767577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1858da-cf2f-4772-bd0c-1022fb7c45ae None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.781084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.781993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.782313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.782682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.783905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:20.785367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620f76e-1648-4356-9dde-e7a479a4b8b6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:20.787079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:20.792608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.792922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.793250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.810271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:20.811382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:20.867745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1858da-cf2f-4772-bd0c-1022fb7c45ae None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.872316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 109/219] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:20.873119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.904280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.904956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.905238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.905508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.906306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:20.906614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:20.908016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83006160-d2d9-409c-9162-944b5a57030f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:20.915904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 111/220] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:20.918291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d1d3-ab44-40d0-b855-af61f9d85304 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.918635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d1d3-ab44-40d0-b855-af61f9d85304 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.918908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d1d3-ab44-40d0-b855-af61f9d85304 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:20.920616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 112/221] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:20.925294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d1d3-ab44-40d0-b855-af61f9d85304 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:20.965946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c6a41-1fd6-4473-b76a-eb6a66f82cd6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:20.997512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:20.998463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:20.998764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:20.999033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/6252b9ded0b94ddb87e42eed2cd52018/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.001265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, user_id=6252b9ded0b94ddb87e42eed2cd52018, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.002812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.016256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 110/222] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:20 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/6252b9ded0b94ddb87e42eed2cd52018/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:21.017242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.031945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d1d3-ab44-40d0-b855-af61f9d85304 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.068454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.069205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.069484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.069749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.070970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.072462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdecb7-0a2c-43fc-8b56-b3187a667572 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.074146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:21.075436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.075714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.075985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.094113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:21.095344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:21.130048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9c066-13b1-4ea6-97a9-3d68f20dd6f7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.162041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 114/224] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:21.166499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.178291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.180027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.180550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.180965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] PATH_INFO: `/v3/users/92a76b22d835449eabe53e78a90cddcb` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.198053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] RBAC: Authorizing `identity:get_user(user_id=92a76b22d835449eabe53e78a90cddcb)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.199825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.207088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 111/225] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/users/92a76b22d835449eabe53e78a90cddcb => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:21.208234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.277008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d3b1d-21dc-45ee-9d99-448bd5118fe5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.305169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469452-74f1-4116-9a90-386083b507fa None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.313449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.314445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.314946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.315483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.316286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.317794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.338307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.339054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.339334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.339677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.346643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 115/226] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:21 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:21.347482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.351326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:21.362317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:21.362317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 112/227] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:21.366888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.460002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9503e-35ff-4c16-8828-87e6eb93e6bd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.494754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.495422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.495703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.495974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.497232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9e05b-5854-40e0-9632-5061cbb292cf None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.545124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.545831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.546109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.546418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.547242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:21.547550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.549994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.558135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:21.563552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.566710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.568390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.689102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dcf62-9854-4551-bbb8-f75bfc6ec003 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.696438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 116/229] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:21.703423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.727891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.728778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.729058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.729329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.730614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.732140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.733950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:21.741714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.811866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920312-636d-4ca2-be05-b133d70eeaef None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.851169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.852060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.852343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.852619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.857520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abd1-b2fa-49ec-b13d-7479f4c9804b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:21.860598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.863140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.865674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:21.875278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:21.919770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:21.920699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:21.920973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:21.922523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:21.923731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:21.926985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:21.931768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:21.937637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:22.056832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030bde9-2389-4614-9339-2fdf4f75b632 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:22.114769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:22.115466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:22.115702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:22.116166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:22.116990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=92a76b22d835449eabe53e78a90cddcb) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:22.117295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:22.118771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9699-a80c-495c-9b28-f3c785e71fdf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:22.124714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28019a-fea4-4640-9379-55c451f23db2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:22.134630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 118/233] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:21 2022] GET /identity/v3/role_assignments?user.id=92a76b22d835449eabe53e78a90cddcb&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:22.174463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:22.175383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:22.175659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:22.175924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/6252b9ded0b94ddb87e42eed2cd52018/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:22.178351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, user_id=6252b9ded0b94ddb87e42eed2cd52018, role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:22.179936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80219cdd-6389-4174-8c6f-0746a4edf7c0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:22.201765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 116/234] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:21 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/6252b9ded0b94ddb87e42eed2cd52018/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:23.662063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f840dc-560b-4b3c-af9e-df1bde3b1b28 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:23.662632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f840dc-560b-4b3c-af9e-df1bde3b1b28 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:23.662632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f840dc-560b-4b3c-af9e-df1bde3b1b28 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:23.664390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 119/235] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:23.669538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:23.669942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:23.670132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:23.691225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:23.692383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:23.782481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 117/236] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:23.827974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f840dc-560b-4b3c-af9e-df1bde3b1b28 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:23.964078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f840dc-560b-4b3c-af9e-df1bde3b1b28 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.013598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.014790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.015270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.015730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.026103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:24.037479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5a6b0077-1d2c-47ee-8e44-16b09640088b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:24.038975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 120/237] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:24.044882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.200424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b666b-e08b-48d4-9c4a-23ec38ba5320 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.212103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d372d-7a82-4715-a01f-3e5251114238 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.212636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d372d-7a82-4715-a01f-3e5251114238 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.213109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d372d-7a82-4715-a01f-3e5251114238 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.215435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 121/238] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:24.223862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.224431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.224902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.244453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:24.245927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:24.257305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.257984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.258284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.258570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.259314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:24.259617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:24.261008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:24.277795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 118/239] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:24.282882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.319693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 122/240] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:24.343522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.439586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb77e5-d99d-47d1-b10c-2285fab4454b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.473282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.474443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.474921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.475427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.485837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:24.493601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:24.495438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 123/241] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:24.500296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a0f95-1061-44e3-b972-8de8847021c0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.501719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.547986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.549108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.549618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.550025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.551416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:24.553069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d059-9419-4dd1-9577-35aa68b96107 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:24.554864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 119/242] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:24.556160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bb0c-d811-4264-8502-a41c350ea2b0 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.556576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bb0c-d811-4264-8502-a41c350ea2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.556997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bb0c-d811-4264-8502-a41c350ea2b0 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.558787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 120/243] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:24.563514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95bb0c-d811-4264-8502-a41c350ea2b0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.605186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770705-5700-4f1c-8afc-9e06b0460ded None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.639443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.640489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.641003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.641467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.642496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:24.642997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:24.644706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970e524-b9c4-4ad1-a906-b320148ae7b3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:24.653597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 124/244] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:24.659472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.660121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.660594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.666553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95bb0c-d811-4264-8502-a41c350ea2b0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.678194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:24.680038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:24.700728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.701399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.701670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.701933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.753348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 125/245] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:24.754517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.785743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:24.787311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:24.851974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdad56-5104-4588-af47-9ddffd0dfc53 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:24.885747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:24.886672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.886950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.887221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] PATH_INFO: `/v3/users/af7af4ba072547a48f729e66f853e7ce` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.890373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 121/246] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:24.891219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.901972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] RBAC: Authorizing `identity:get_user(user_id=af7af4ba072547a48f729e66f853e7ce)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:24.903576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0cf01-628d-4ae4-b9b3-7621cca5d988 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:24.905283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 126/247] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/users/af7af4ba072547a48f729e66f853e7ce => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:24.911154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa9ae-0999-4456-b9cc-46ecc4eaba41 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:24.911436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa9ae-0999-4456-b9cc-46ecc4eaba41 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:24.911708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa9ae-0999-4456-b9cc-46ecc4eaba41 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:24.913379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 127/248] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:24.914072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa9ae-0999-4456-b9cc-46ecc4eaba41 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:24.996252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61231f0-4456-4625-8f6e-7ac090711e03 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.009889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa9ae-0999-4456-b9cc-46ecc4eaba41 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.031263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.032266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.032397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.032596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.033848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.035533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.036962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 122/249] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.037716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.047784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.048344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.048610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.048921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.050139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.051610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d25ecc-8728-4751-8029-1e27c6563d86 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.053323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:24 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.054453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.054728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.054994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.072179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:25.073349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:25.133744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 129/251] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:25.134617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.136978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00914c-616a-4b89-954f-de0489cb7135 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.170235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.170906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.171182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.171455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.229195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c78de1-72a5-46cb-9e85-8176b0e1469c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.235112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.236574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.263256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.263859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.264139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.264408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.265106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.266578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b76bc-1f44-4662-ac26-a2b76f20eb53 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.286465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 130/252] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:25 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:25.287692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860985-1a4e-4f19-ab99-25aac71994ec None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.287973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860985-1a4e-4f19-ab99-25aac71994ec None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.288238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860985-1a4e-4f19-ab99-25aac71994ec None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.289935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 131/253] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:25.290702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860985-1a4e-4f19-ab99-25aac71994ec None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.340533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 123/254] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:25.341318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.397761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860985-1a4e-4f19-ab99-25aac71994ec None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.432492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.433164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.433445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.433717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.434614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=6252b9ded0b94ddb87e42eed2cd52018) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:25.434928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.436439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63a85b-5685-4893-8166-d938024826e1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.450295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 132/255] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/role_assignments?user.id=6252b9ded0b94ddb87e42eed2cd52018&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.450515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbcef-f297-4ee8-9ce8-d785494a3468 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.450638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.450638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.450638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.476123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:25.477358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:25.482660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.483533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.483814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.484089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.497431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:25.504702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:25.506108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 124/256] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:25.506846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.560724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 133/257] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:25.561606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.628747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a72e-8ee9-4390-a8fe-8bdecb4ed435 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.664538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.665840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.666134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.666434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.667646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.669132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.671013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 125/258] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.671599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.679307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ac34-9b7e-49ca-9edb-a88ec508bd6e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.713855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.714640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.714925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.715200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.715955 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:25.716260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.717648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.726270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 134/259] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.727182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.772426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a0eb0-47e6-40f4-8b7d-0546f2d13618 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.805251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.806070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.806376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.806651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.817199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:25.824575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:25.825512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71b54-bf97-4700-870f-9c71057a2b19 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:25.826090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 126/260] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:25.826900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.864335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:25.865007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:25.865285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:25.865557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:25.866418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=af7af4ba072547a48f729e66f853e7ce) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:25.866730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:25.868249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:25.873926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 135/261] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/role_assignments?user.id=af7af4ba072547a48f729e66f853e7ce&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=11d741f5bead46dd867e05f4fec25133 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:25.874842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:25.997355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb1f6c-e502-407f-830c-9032284e6bdb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.045758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d1f9-1abc-4919-927c-6a5928a1d9fc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.080267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.080473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.081029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.081131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.081314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.081478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.081619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.081754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] PATH_INFO: `/v3/users/92a76b22d835449eabe53e78a90cddcb` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.082362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:26.082669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.082862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=92a76b22d835449eabe53e78a90cddcb)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.084045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.084298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.086218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 127/262] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/users/92a76b22d835449eabe53e78a90cddcb => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:26.091835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.092904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 136/263] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:26.098517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.192316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0650e0-6065-4e6b-ab59-c0d5feec5ff1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.213171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ccd80-f746-4253-83e0-f6f92a780e35 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.231863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.232749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.233023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.233290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.234507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.235965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.237689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 128/264] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:26 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:26.247372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.275577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.276476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.276755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.277026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] PATH_INFO: `/v3/users/6252b9ded0b94ddb87e42eed2cd52018` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.279100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] RBAC: Authorizing `identity:get_user(user_id=6252b9ded0b94ddb87e42eed2cd52018)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.280573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.282217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 137/265] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:26 2022] GET /identity/v3/users/6252b9ded0b94ddb87e42eed2cd52018 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:26.288802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.386323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170cad1-7e2b-4f7a-9a1a-0487717ab074 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.449651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.450581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.450861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.451132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/92a76b22d835449eabe53e78a90cddcb/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.454386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, user_id=92a76b22d835449eabe53e78a90cddcb, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.455876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.478421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 129/266] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:26 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/92a76b22d835449eabe53e78a90cddcb/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:04:26.480252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a40c1-1d5e-43d9-a408-91fbe7a959ce None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.533616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.534357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.534638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.534908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.614859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.616362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.721549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 138/267] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:26.727106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.826130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899643bb-1a06-4ea3-b52b-f9c32644686a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:26.859126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:26.860003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:26.860282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:26.860551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:26.861745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:26.863287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3034a-332e-4bfa-b87e-e37a1c1d4ab7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:26.865614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 130/268] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:26 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:26.871596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:26.971336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e316708-7547-448c-ba9c-22ff0de4a676 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:27.008189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:27.008770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:27.009127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:27.009314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:27.010138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=6252b9ded0b94ddb87e42eed2cd52018) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:27.010473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:27.011916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b874-90d3-40a6-b009-87b5e9c2124d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:27.017631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 139/269] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:26 2022] GET /identity/v3/role_assignments?user.id=6252b9ded0b94ddb87e42eed2cd52018&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:28.011215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688dbd8-aa31-4e4b-b266-edfbe8e3284d None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.011948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688dbd8-aa31-4e4b-b266-edfbe8e3284d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.011948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688dbd8-aa31-4e4b-b266-edfbe8e3284d None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.013545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 131/270] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:28.018904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f78f6-7aaf-4c98-a9be-00a72ef8f029 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.019369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f78f6-7aaf-4c98-a9be-00a72ef8f029 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.019513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f78f6-7aaf-4c98-a9be-00a72ef8f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.036330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a62f78f6-7aaf-4c98-a9be-00a72ef8f029 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:28.037517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a62f78f6-7aaf-4c98-a9be-00a72ef8f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:28.106957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 140/271] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:28.108700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ebaf-aa4c-4f1d-b6a0-967f9f6ae22d None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.108986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ebaf-aa4c-4f1d-b6a0-967f9f6ae22d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.109259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ebaf-aa4c-4f1d-b6a0-967f9f6ae22d None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.111308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 132/272] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:28.119587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.119877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.120155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.129558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678ebaf-aa4c-4f1d-b6a0-967f9f6ae22d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.137000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:28.138178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:28.210395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 141/273] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:28.230288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.230512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678ebaf-aa4c-4f1d-b6a0-967f9f6ae22d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.264278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.265119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.265395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.265661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.275955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:28.282905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:28.284452 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 133/274] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:28.289941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.326525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05625-0397-4ba2-9d1e-0fc1a7f9b182 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.359852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.360711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.360995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.361270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.362498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:28.364325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:28.370491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 142/275] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:28.371651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.388836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141090-e55b-42d3-8a36-9b0f14782dd6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.421771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.422472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.422748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.423014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.424177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:28.424555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:28.426412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:28.437278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 134/276] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:28.442839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.472652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642add1b-89de-41fa-9b84-de88a3d0c0d7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.510996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.511828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.512413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.512698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.513668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:28.515210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538d60-35d8-4921-bd65-c47c3e36d576 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:28.540992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 143/277] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:28 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:04:28.556090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9450a3-f235-48ed-a2de-fc705b42316e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.595424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.596781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.597055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.597323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] PATH_INFO: `/v3/users/4a21135299b44da5885a8cc1f930da46` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.597743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3df4-3162-46b8-83d8-075be8b7edb3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.598147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3df4-3162-46b8-83d8-075be8b7edb3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.598548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3df4-3162-46b8-83d8-075be8b7edb3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.600758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 144/278] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:28.606570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.606920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.607201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.616646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] RBAC: Authorizing `identity:get_user(user_id=4a21135299b44da5885a8cc1f930da46)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:28.618185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:28.620453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 135/279] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/users/4a21135299b44da5885a8cc1f930da46 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:28.625964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:28.626304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.627211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:28.696215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 145/280] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:28.718502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:28.731263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7fea0-4922-4b79-a1fc-3f90d1900063 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.778680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.779711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.780185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.780650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.781682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, user.id=4a21135299b44da5885a8cc1f930da46, scope.system=all) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:28.782190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:28.783957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:28.794113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 136/281] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/role_assignments?user.id=4a21135299b44da5885a8cc1f930da46&scope.system=all&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:28.839432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba3d8-ddfa-45e2-8e5d-c32d739c629b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:28.880643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:28.881888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:28.882353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:28.882768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:28.896582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:28.904318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:28.906222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 146/282] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:28.912432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.028336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095cb7c-3c2b-4678-a646-a49b112b9e03 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.065770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.067668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.067945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.068210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.068959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:29.069258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:29.070667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a1cd-590e-4595-a871-7eebf0986f12 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:29.079577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 137/283] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:29.085008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.162401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690a5c-9390-4611-b5d3-15a6a2960038 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.162738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690a5c-9390-4611-b5d3-15a6a2960038 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.162957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690a5c-9390-4611-b5d3-15a6a2960038 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.164943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 138/284] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:29.170022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.170347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.170622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.199032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082abee3-a785-4c51-917a-03c79f342e6f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.211909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:29.213089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:29.246043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.247023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.247308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.247582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] PATH_INFO: `/v3/users/af7af4ba072547a48f729e66f853e7ce` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.248834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] RBAC: Authorizing `identity:get_user(user_id=af7af4ba072547a48f729e66f853e7ce)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:29.250409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:29.252388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 147/285] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:29 2022] GET /identity/v3/users/af7af4ba072547a48f729e66f853e7ce => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:29.257693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.339950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 139/286] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:29.355148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91519c3-759e-4fe1-8c0a-7fb5508779fb None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.374694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.392852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.393793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.394077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.394403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.396065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:29.398387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:29.401521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 148/287] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:29 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:29.408903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.570885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745e1f-c671-41fe-aae6-b9caa62d5b7e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.573223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725e16-d32f-45a1-8585-abc2b4ffe1e6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.633610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.635720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.635829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.636333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.636565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.636843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.637114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.637397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/af7af4ba072547a48f729e66f853e7ce/roles/11d741f5bead46dd867e05f4fec25133` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.639690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, user_id=af7af4ba072547a48f729e66f853e7ce, role_id=11d741f5bead46dd867e05f4fec25133)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:29.641647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:29.660000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:29.670054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:04:29 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/users/af7af4ba072547a48f729e66f853e7ce/roles/11d741f5bead46dd867e05f4fec25133 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:29.678507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:29.680803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:29.687813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:29.833792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aea7f-1d70-4ebc-b0a7-11ef1df4128e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:29.882152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:29.883220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:29.883777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:29.884253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:29.885201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:29.885730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:29.887352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:29.904633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 150/290] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:29.910567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:30.036597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59362ac-18d3-44c8-96af-790217d078e1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:30.073009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:30.073899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:30.074181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:30.074498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] PATH_INFO: `/v3/users/92a76b22d835449eabe53e78a90cddcb` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:30.075727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] RBAC: Authorizing `identity:get_user(user_id=92a76b22d835449eabe53e78a90cddcb)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:30.077187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:30.079743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 141/291] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:29 2022] GET /identity/v3/users/92a76b22d835449eabe53e78a90cddcb => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:30.084548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:30.241587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c482-f96f-4c9c-a120-7f1b3987381c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:30.292772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:30.293430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:30.293709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:30.293981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:30.369317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:30.371137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:30.465898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:30.471122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:30.591550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b2f2b-4c24-472f-b33e-ce454a30f80e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:30.637599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:30.638830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:30.639284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:30.639725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:30.646976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:30.648628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038e8a3-7855-499c-a69b-c638c4d6175a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:30.650556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:30 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:30.656541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:30.760126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273a04-647b-45ca-b4ca-b246665a6380 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:30.797274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:30.798283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:30.798739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:30.799185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:30.800224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=92a76b22d835449eabe53e78a90cddcb) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:30.800705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:30.802355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b58b45-be59-4935-b9bd-7659f459ff8d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:30.808804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 152/294] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:30 2022] GET /identity/v3/role_assignments?user.id=92a76b22d835449eabe53e78a90cddcb&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:31.432520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c974-930d-4ddc-a18e-57b6f6d36921 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.433521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c974-930d-4ddc-a18e-57b6f6d36921 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.434002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c974-930d-4ddc-a18e-57b6f6d36921 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.436322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 143/295] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:31.441507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbfdb-e80f-497c-9956-bed6e4f3ff55 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.441947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbfdb-e80f-497c-9956-bed6e4f3ff55 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.442051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbfdb-e80f-497c-9956-bed6e4f3ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.461854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aad74-bd7c-4665-9e45-32d252c34335 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.462037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-86fcbfdb-e80f-497c-9956-bed6e4f3ff55 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:31.462588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aad74-bd7c-4665-9e45-32d252c34335 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.463063 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aad74-bd7c-4665-9e45-32d252c34335 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.463163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-86fcbfdb-e80f-497c-9956-bed6e4f3ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:31.465115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 144/296] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:31.470454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d14f-2848-4ee9-90a4-10d48234fe5f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.470981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d14f-2848-4ee9-90a4-10d48234fe5f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.471507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d14f-2848-4ee9-90a4-10d48234fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.496052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c7d3d14f-2848-4ee9-90a4-10d48234fe5f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:31.497531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c7d3d14f-2848-4ee9-90a4-10d48234fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:31.546239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 153/297] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:31.566162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e657c-af7c-4271-b03d-d710a686a44e None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.566518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e657c-af7c-4271-b03d-d710a686a44e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.566798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e657c-af7c-4271-b03d-d710a686a44e None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.569223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 154/298] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:31.569621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 145/299] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:31.573238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e657c-af7c-4271-b03d-d710a686a44e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.574820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.575310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.575774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.592301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:31.593469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:31.656944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 146/300] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:31.667187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.673375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e657c-af7c-4271-b03d-d710a686a44e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:31.707357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:31.708158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.708433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.708698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.718762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:31.725732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:31.727380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 155/301] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:31.727764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.769745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e052-d2e4-442b-8b0d-c98025cbd967 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:31.801439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:31.802242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.802547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.802819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.803981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:31.805409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:31.811680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 147/302] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:31.811680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.830384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331260-df2b-4b99-96f5-6946fe0358f2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:31.861866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:31.862696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.862976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.863245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.874823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:31.883772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:31.885722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 156/303] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:31.890948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.905378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a43eff-f1cc-408a-97cd-4833020f7041 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:31.939436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:31.940133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:31.940410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:31.940681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:31.941425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:31.941725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:31.943123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:31.951178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 148/304] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:31.951878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:31.991529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50050c6-6ecc-4e20-9026-3a0b1a1565ff None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.024426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.025100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.025381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.025654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] PATH_INFO: `/v3/groups` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.026367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.027808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.043066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 157/305] 10.222.0.18 () {60 vars in 1134 bytes} [Sun Mar 20 16:04:31 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:32.044268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.065627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cd6c3-4cbd-4d37-ae4f-cb2156aa28a9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.101433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.102110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.102454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.102736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.103496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:32.103794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.105245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.119705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 149/306] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:32.120737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.179239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779894ab-4c9e-423f-a56b-f19e9641c8f1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.236936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.237355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b49e-66c0-4fd3-ab6d-d5e52a16b500 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.238808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.239541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.240934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] PATH_INFO: `/v3/users/82063eeccf4f40a585b5bf304f3b3086` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.259068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] RBAC: Authorizing `identity:get_user(user_id=82063eeccf4f40a585b5bf304f3b3086)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.260764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.262872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 158/307] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:32 2022] GET /identity/v3/users/82063eeccf4f40a585b5bf304f3b3086 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:32.268481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.277676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.279036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.279036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.279200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] PATH_INFO: `/v3/users/4a21135299b44da5885a8cc1f930da46` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.280661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] RBAC: Authorizing `identity:get_user(user_id=4a21135299b44da5885a8cc1f930da46)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.282816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.284982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 150/308] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:32 2022] GET /identity/v3/users/4a21135299b44da5885a8cc1f930da46 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:32.290836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.388941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a46942-5c41-4137-a8c8-096bd101baac None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.404636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e16ca-1fd1-4c90-a97d-a306012ef726 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.421746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.422594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.422703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.422975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.423798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, user.id=82063eeccf4f40a585b5bf304f3b3086, scope.system=all) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:32.424103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.425569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eab07-3974-47e8-b38c-02e5b90bf719 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.430609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 159/309] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Mar 20 16:04:32 2022] GET /identity/v3/role_assignments?user.id=82063eeccf4f40a585b5bf304f3b3086&scope.system=all&role.id=11d741f5bead46dd867e05f4fec25133 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:32.441048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.442860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.443365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.443872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] PATH_INFO: `/v3/system/users/4a21135299b44da5885a8cc1f930da46/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.445802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4a21135299b44da5885a8cc1f930da46, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:32.447585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada530-fe10-4ef8-b6c3-98b43a4cdb31 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:32.461071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 151/310] 10.222.0.18 () {58 vars in 1334 bytes} [Sun Mar 20 16:04:32 2022] PUT /identity/v3/system/users/4a21135299b44da5885a8cc1f930da46/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:32.494809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a0f4-f6c3-464d-b081-4d3c0280781d None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.495334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a0f4-f6c3-464d-b081-4d3c0280781d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.495334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a0f4-f6c3-464d-b081-4d3c0280781d None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.497456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 160/311] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:32.503268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.503583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.503812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.522980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:32.524112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:32.599570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 152/312] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:32.623584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a0f4-f6c3-464d-b081-4d3c0280781d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.725496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a0f4-f6c3-464d-b081-4d3c0280781d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:32.759037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:32.759842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:32.760118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:32.760388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:32.770776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:32.777662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:32.779204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 161/313] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:32.785076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:32.904982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e493-ab1d-48ca-9527-45b7163459ab None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:33.058467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:33.059057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:33.059328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:33.059594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:33.060334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:33.060634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:33.061995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:33.070056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 153/314] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:33.076738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:33.175914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72880d4-8663-4fc0-bb43-0ce2692118ed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:33.210279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:33.210279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:33.210279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:33.210279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] PATH_INFO: `/v3/users/af7af4ba072547a48f729e66f853e7ce` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:33.211265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] RBAC: Authorizing `identity:get_user(user_id=af7af4ba072547a48f729e66f853e7ce)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:33.212726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:33.214659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 162/315] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:33 2022] GET /identity/v3/users/af7af4ba072547a48f729e66f853e7ce => generated 297 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:33.219843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:33.318562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7d98-a861-48b7-825f-4b84378bdae8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:33.350958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:33.351609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:33.351995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:33.352267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:33.416275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:33.417717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:33.513514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 154/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:33.519101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:33.617392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017685ab-e04a-4efa-9ed8-bda955dbabd3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:33.649687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:33.650594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:33.650869 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:33.651133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:33.652303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:33.653732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde616b-8403-49a0-8c77-6d36a70f2994 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:33.655868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 163/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:33 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:33.661682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:33.758156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c99785-4b30-483a-ad8a-fbd7136356bd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:33.790164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:33.790849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:33.791127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:33.791392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:33.792217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1, user.id=af7af4ba072547a48f729e66f853e7ce) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:33.792519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:33.793948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89e07-7d3a-4c54-a1b5-43774a13c8da None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:33.799963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 155/318] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:04:33 2022] GET /identity/v3/role_assignments?user.id=af7af4ba072547a48f729e66f853e7ce&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=11d741f5bead46dd867e05f4fec25133 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:34.403597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6cb73-9c9f-4794-9630-6ceaba6d94fa None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.403843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6cb73-9c9f-4794-9630-6ceaba6d94fa None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.404311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6cb73-9c9f-4794-9630-6ceaba6d94fa None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.406245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 164/319] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:34.411772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.412121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.412296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.430494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:34.431687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:34.502707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:34.525091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6cb73-9c9f-4794-9630-6ceaba6d94fa None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:34.624435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6cb73-9c9f-4794-9630-6ceaba6d94fa None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:34.657785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:34.658803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.659081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.659340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.660507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:34.661945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fb410-45e5-4fa4-8c77-2fa8ab71dbcb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:34.666332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 165/321] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:34.669277 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:34.763906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85a8f-e760-4b75-802b-e70b28912665 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:34.779297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef885e-5192-4b68-ae03-cd11ab977951 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.779591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef885e-5192-4b68-ae03-cd11ab977951 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.779840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef885e-5192-4b68-ae03-cd11ab977951 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.782284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 166/322] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:34.786745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee97b-7841-4588-a109-3a076b753484 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.787033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee97b-7841-4588-a109-3a076b753484 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.787311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee97b-7841-4588-a109-3a076b753484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.798504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:34.799182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.799518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.799791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] PATH_INFO: `/v3/groups` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.800478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:34.801932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee5ebf-0a7c-4568-a8e1-38f0530e7263 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:34.804848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-958ee97b-7841-4588-a109-3a076b753484 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:34.806024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-958ee97b-7841-4588-a109-3a076b753484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:34.818210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 157/323] 10.222.0.18 () {60 vars in 1134 bytes} [Sun Mar 20 16:04:34 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:34.839737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933950-e937-4e68-b953-446338777a71 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.840068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933950-e937-4e68-b953-446338777a71 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.840286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933950-e937-4e68-b953-446338777a71 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.842302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 158/324] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:34.847870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:34.848164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:34.848478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:34.865374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:34.866592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:34.885052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 167/325] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:34.907814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee97b-7841-4588-a109-3a076b753484 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:34.937704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 159/326] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:34.961685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.008476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee97b-7841-4588-a109-3a076b753484 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.043900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.044707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.044982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.045252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.055514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:35.059469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e51a35-9b0d-4837-9e76-09807f4e32a5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.062554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:35.064510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 168/327] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:35.069544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.093924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.094765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.095043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.095319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.106173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:35.113731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:35.115313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 160/328] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:35.121024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.169670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383196-54e1-4c12-91e8-26f101a634b2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.224094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091ac5-9c64-4582-83ac-fcbd0d2aa067 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.261208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0796-0c3c-4210-9795-00212965524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.261894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0796-0c3c-4210-9795-00212965524d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.262178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0796-0c3c-4210-9795-00212965524d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.262484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0796-0c3c-4210-9795-00212965524d None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.263252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0796-0c3c-4210-9795-00212965524d None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:35.263557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0796-0c3c-4210-9795-00212965524d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.264968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0796-0c3c-4210-9795-00212965524d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.274868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 161/329] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:35.280489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0796-0c3c-4210-9795-00212965524d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.324370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.324962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.325245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.325510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.326274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:35.326585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.327969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.336664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 169/330] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:35.342223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.378913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0796-0c3c-4210-9795-00212965524d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.411540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.412429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.412708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.412979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] PATH_INFO: `/v3/users/4a21135299b44da5885a8cc1f930da46` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.414191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] RBAC: Authorizing `identity:get_user(user_id=4a21135299b44da5885a8cc1f930da46)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.415655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.417566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 162/331] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:35 2022] GET /identity/v3/users/4a21135299b44da5885a8cc1f930da46 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:35.423168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.442324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063513f9-3bb1-4176-a239-b9d4c0e7499f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.477397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.478283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.478571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.478838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] PATH_INFO: `/v3/users/82063eeccf4f40a585b5bf304f3b3086` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.480347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] RBAC: Authorizing `identity:get_user(user_id=82063eeccf4f40a585b5bf304f3b3086)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.481567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.483237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 170/332] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:35 2022] GET /identity/v3/users/82063eeccf4f40a585b5bf304f3b3086 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:35.490871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:35.535321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98244ce9-3f79-4e4e-b3b7-367a609b342f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.567907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.568569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.568851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.569125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.569953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] RBAC: Adding query filter params (role.id=05f5a690bee14e8396c0c920bcf0fb2b, user.id=4a21135299b44da5885a8cc1f930da46, scope.system=all) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:35.570278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.571849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad7e51-6593-4d7e-b95d-946d3c2e8af0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.583613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 163/333] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Mar 20 16:04:35 2022] GET /identity/v3/role_assignments?user.id=4a21135299b44da5885a8cc1f930da46&scope.system=all&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:35.599959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecce9f-256c-42d7-92c5-cad0cdceabf3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:35.640506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:35.641772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:35.642248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:35.642771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] PATH_INFO: `/v3/system/users/82063eeccf4f40a585b5bf304f3b3086/roles/11d741f5bead46dd867e05f4fec25133` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:35.644718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=82063eeccf4f40a585b5bf304f3b3086, role_id=11d741f5bead46dd867e05f4fec25133)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:35.646438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f63d8-184e-4999-94b2-f8ae0e47ba92 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:35.660134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 171/334] 10.222.0.18 () {58 vars in 1334 bytes} [Sun Mar 20 16:04:35 2022] PUT /identity/v3/system/users/82063eeccf4f40a585b5bf304f3b3086/roles/11d741f5bead46dd867e05f4fec25133 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:37.627020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e566-76ec-4193-8e41-9b74c56c18c6 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:37.627598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e566-76ec-4193-8e41-9b74c56c18c6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:37.627673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e566-76ec-4193-8e41-9b74c56c18c6 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:37.629713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 164/335] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:37.635694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400476-a98f-46ce-b8a5-73b2aa16fcfa None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:37.636139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400476-a98f-46ce-b8a5-73b2aa16fcfa None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:37.636312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e400476-a98f-46ce-b8a5-73b2aa16fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:37.653998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6e400476-a98f-46ce-b8a5-73b2aa16fcfa None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:37.655275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6e400476-a98f-46ce-b8a5-73b2aa16fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:37.731964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:37.763636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e566-76ec-4193-8e41-9b74c56c18c6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:37.780167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddcf35-8edc-4087-be7f-629840a1e6b4 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:37.780487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddcf35-8edc-4087-be7f-629840a1e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:37.780716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddcf35-8edc-4087-be7f-629840a1e6b4 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:37.782789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 173/337] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:37.787798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:37.788079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:37.788408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:37.807891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:37.809059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:37.879975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e566-76ec-4193-8e41-9b74c56c18c6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:37.896442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 174/338] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:37.917673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:37.918510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:37.918787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:37.919055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:37.924118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:37.930127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:37.937190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:37.938455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 165/339] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:37.944934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.134637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02544-bff9-495b-9ca4-2c90c41c7c4c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.142597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc18116-cc4a-4f8c-aea3-13dc70b339f6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.221379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.221379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.221379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.221379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.224377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.225326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.225805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.226292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.227249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:38.227750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:38.229322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:38.245539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 166/340] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:38.247314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:38.251234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.254923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:38.261030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 175/341] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:38.262203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.425976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fe38f-ed9c-4f60-a379-0fed3e0d291a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.469887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d6b11-7d31-411b-886a-c735c55aab76 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.494530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.495191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.495464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.495731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.543009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.544075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.544584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.545060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.546035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:38.546571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:38.548160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:38.560405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 176/342] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:38.568223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.583859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:38.585314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:38.698833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 167/343] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:38.704174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.710322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacfb3c-56a4-4de1-831a-922c156ce042 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.745514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.746593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.747090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.747566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.807212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9b57-6cb9-4dcf-bab6-059217eaf838 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.815957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:38.817713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdbd87-ebb6-496a-80ab-d5f8a4003937 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:38.845293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:38.846209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.846510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.846780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.849320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:38.850942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:38.852930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 168/344] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:38 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:38.858284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:38.949194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:38.950514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a11d8-1e34-4cd5-9f30-e79060caabef None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.950800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a11d8-1e34-4cd5-9f30-e79060caabef None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.951072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a11d8-1e34-4cd5-9f30-e79060caabef None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.952747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 178/346] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:38.958074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:38.958233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:38.958522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:38.988763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834191ec-a074-417a-a479-a6adc7270427 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:38.991907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:38.992412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:39.025934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.027341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.027861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.028355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.035624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.037886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:39.040158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 169/347] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:38 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:39.041227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.147907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c149fb-8364-4dce-a6fc-adccb50fb906 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.151230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 179/348] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:39.152163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.187709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.189040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.189792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.190354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.192539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.194530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:39.197074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 170/349] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:39.203296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.289922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf262-f68b-42da-8334-28de1444c6b9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.308626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e7a1f-760b-4006-8cc5-d12aa6c3487b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.324770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.325439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.325717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.325989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.326853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:39.327221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.328720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695c7c4-564b-4bdb-861f-1287b64a5c4f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:39.334386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 180/350] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:39.335672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4470-fd3c-484d-83f2-e9ebfa15d282 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.335954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4470-fd3c-484d-83f2-e9ebfa15d282 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.336221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde4470-fd3c-484d-83f2-e9ebfa15d282 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.342428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 181/351] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:39.343394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde4470-fd3c-484d-83f2-e9ebfa15d282 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.351616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.352581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.352862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.353197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.356721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.358901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24edc-8202-4749-adb6-ca807eb21834 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:39.361647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 171/352] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:39.368406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.368966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.369424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.389656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:39.391375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:39.516100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 172/353] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:39.517273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.553327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde4470-fd3c-484d-83f2-e9ebfa15d282 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.591310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.592461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.592942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.593462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.607520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:39.615521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:39.617308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 182/354] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:39.618301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.676911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee87f-9a55-4ba5-9e56-da50f4069740 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.715000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.716363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.716793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.717229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.718205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:39.718686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.720269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511ea7-956c-4e7d-8bfe-e25f779f4f4b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:39.722691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d78c6-3aea-44ea-9dde-dc3f08390b73 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.726927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 173/355] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:39.728512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837cc9-1914-406d-9391-c6b28d650c79 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.728951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837cc9-1914-406d-9391-c6b28d650c79 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.729376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837cc9-1914-406d-9391-c6b28d650c79 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.731276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 174/356] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:39.732297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837cc9-1914-406d-9391-c6b28d650c79 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.758514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.759330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.759818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.760308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.771874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:39.779566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-1e701959-1872-4821-b966-34c1ce1ad7ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 20 16:04:39.781182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 183/357] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:39.782724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.783206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.783736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.815318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:39.817139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:39.920957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837cc9-1914-406d-9391-c6b28d650c79 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:39.967657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 184/358] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:39.969716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:39.974600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:39.975548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:39.976524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:39.978110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:39.980097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:39.980578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:39.984792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.001262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 175/359] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:40.004242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.126005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c61d1-05c6-45f8-8e61-25b4a3db0288 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.171877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0773-7068-47ed-a325-f587f02ffad6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.190382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.191214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.191485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.191751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.224285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:40.231760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:40.246715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 176/360] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:40.247647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.255862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.256548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.256819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.257085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.257838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:40.258132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.259536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.277286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 185/361] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:40.279592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.363339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b36269-9554-4a26-ace4-d435a36d3aa2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.381110 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac404e6-8436-4d67-bee8-5d5fe0d56fdc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.401711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.402650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.403078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.403497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.417081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.418079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.418472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.418996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.419773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:40.420079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.421970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.433002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 186/362] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:40.434469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.487942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.490034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.551065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b1aa-7f05-4328-ac84-6dcfc9696372 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.589616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.590932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.591425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.591890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] PATH_INFO: `/v3/users/82063eeccf4f40a585b5bf304f3b3086` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.593408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] RBAC: Authorizing `identity:get_user(user_id=82063eeccf4f40a585b5bf304f3b3086)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.595071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076f36-dda1-447d-b0fd-d7c5f23241c0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.596960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 187/363] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/users/82063eeccf4f40a585b5bf304f3b3086 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:40.598455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c250-6d40-4bcd-bb9b-81a120d5b9a0 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.598946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c250-6d40-4bcd-bb9b-81a120d5b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.599406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4c250-6d40-4bcd-bb9b-81a120d5b9a0 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.601449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 188/364] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:40.602342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4c250-6d40-4bcd-bb9b-81a120d5b9a0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.614086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 177/365] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:40.615257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.733450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4c250-6d40-4bcd-bb9b-81a120d5b9a0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.743296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007048bc-f647-4700-aa06-7b576de3a061 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:40.772232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.773597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.774043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.775047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.787719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:40.788386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.788666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.788938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.789768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] RBAC: Adding query filter params (role.id=11d741f5bead46dd867e05f4fec25133, user.id=82063eeccf4f40a585b5bf304f3b3086, scope.system=all) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:40.790746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.793631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9322a-23c0-4c7c-aed6-2545fbbf81e7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.810402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 178/366] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/role_assignments?user.id=82063eeccf4f40a585b5bf304f3b3086&scope.system=all&role.id=11d741f5bead46dd867e05f4fec25133 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:40.812146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:40.812631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:40.813103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:40.831855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:40.833448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:40.859362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:40.861340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:40.915433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 179/367] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:40.923659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:40.978821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 189/368] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:40.979709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.044365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de55c6-cafc-4b7b-acab-3d1eef33a416 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.082007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.083859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.084556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.085225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.087970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.089627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.091595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 180/369] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.092749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.098610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777471-eff7-468a-bedf-3f7bd9d9ff0c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.141444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.142576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.142856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.143226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.157797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:41.166697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:41.170933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 190/370] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:41.170933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.215118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edcaa9-45e7-4b48-a7f2-14a5c1d6976e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.252777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.254025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.254530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.255022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.256470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.258242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.260546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 181/371] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.261571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.281387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513199e5-ebc0-4c75-808f-d8b0dd8b0c16 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.325324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.326574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.327076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.327562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.329130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.330936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.338282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 191/372] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.339517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.385741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574fe5-9862-4303-a7e3-e29520ee38a2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.436430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.437111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.437389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.437659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.438445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:41.438746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.440203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.451285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 182/373] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.451285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.453308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4739cb7-fd25-4fcc-8d39-e2e7619ea637 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.509753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.510724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.511006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.511276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.512654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.514093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.518034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 192/374] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.518863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.573232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9defc-00b7-4af6-bfa1-7c55403f074a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.616308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.617375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.617658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.617934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.619058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:41.619529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.621680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.628713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba6c4-785e-49ad-b53d-705e8f577fd0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.630343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 183/375] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.631198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:41.700663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.701386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.701667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.701937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.830855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.832350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e871e4-4453-41f5-8b31-0cd1650da287 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.858216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f158c-f8c7-419d-aec8-c28bdb0a0ee3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:41.893187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:41.893774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:41.894056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:41.894399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:41.895656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:41.895970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:41.897427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:41.905407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 184/376] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:41.959227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 193/377] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:41.965029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.071369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171228-ca86-4894-9843-c7e26bf4b2cd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.092501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859b88-c037-493b-bfdc-91a817015501 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.092835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859b88-c037-493b-bfdc-91a817015501 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.093057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859b88-c037-493b-bfdc-91a817015501 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.095394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 194/378] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:42.101660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.101974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.102214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.129635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:42.130847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:42.134097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.135088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.135367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.135633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] PATH_INFO: `/v3/projects/c02cce03c9e142bab39baeb17444c822` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.137680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] RBAC: Authorizing `identity:get_project(project_id=c02cce03c9e142bab39baeb17444c822)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:42.139520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:42.147172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 185/379] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:41 2022] GET /identity/v3/projects/c02cce03c9e142bab39baeb17444c822 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:42.147172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.262578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 195/380] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:42.302145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.313289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357761-385e-40d7-82c8-aa235a72fe6c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.386977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.387860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.388136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.388402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] PATH_INFO: `/v3/groups/1c5ffce369d14805b31a7d23b833b411` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.403017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] RBAC: Authorizing `identity:get_group(group_id=1c5ffce369d14805b31a7d23b833b411)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:42.404416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:42.406120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 186/381] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/groups/1c5ffce369d14805b31a7d23b833b411 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:42.412143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.420602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a18797-5b05-40b5-a477-159a0b0ea0eb None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.464717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.465528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.465805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.466075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.480181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:42.488193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:42.490027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 196/382] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:42.499242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.519124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf547c5-5b80-4bcc-aafc-7905fc9483a4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.551618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.552275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.552554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.552822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.553642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] RBAC: Adding query filter params (group.id=1c5ffce369d14805b31a7d23b833b411, role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=c02cce03c9e142bab39baeb17444c822) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:42.553942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:42.555406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:42.561167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 187/383] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/role_assignments?group.id=1c5ffce369d14805b31a7d23b833b411&scope.project.id=c02cce03c9e142bab39baeb17444c822&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:42.619923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265a7d-51a9-4186-a50f-2df2b432b9ab None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.664804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.665421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.665700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.665974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.666769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:42.667070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:42.668475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b31b10-7bfa-43cc-9526-180e94a4ed72 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:42.678466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 197/384] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:42.684357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.852549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c897ed-2c3e-48e5-8019-3ca53968247f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:42.890634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb405-eec9-458f-9932-8329962b1634 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.891755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb405-eec9-458f-9932-8329962b1634 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.891755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb405-eec9-458f-9932-8329962b1634 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.893045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 198/385] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:42.899501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:42.900176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.900365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:42.900533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.900692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:42.900835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.900975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:42.903200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:42.904744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:42.907201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 188/386] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:42.915354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:42.931627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:42.932720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:43.016183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb785-5a70-4a44-a485-06425429eb04 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.050207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.051494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.051989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.052456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.054013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:43.055696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:43.058036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 189/387] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:42 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:43.063203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:43.078902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 199/388] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:43.149437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:43.232147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da403-df2d-4aaa-adab-9d2854da1e09 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.276138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.277052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.277338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.277609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/groups/4f32256fb53542c4832664a9ec3f084f/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.279878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, group_id=4f32256fb53542c4832664a9ec3f084f, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:43.281389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:43.303657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 190/389] 10.222.0.18 () {58 vars in 1442 bytes} [Sun Mar 20 16:04:43 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/groups/4f32256fb53542c4832664a9ec3f084f/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:43.338643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188742-6caf-4691-bc1e-1ae8d55b028e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.375635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.376469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.376744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.377013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.388542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:43.396334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:43.398002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 200/390] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:43.403361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:43.515973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bed9-fdf6-4fa3-b369-4942b7de4d02 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.550515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.551200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.551479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.551758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.552519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:43.552825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:43.554198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:43.563473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 191/391] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:43.568961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:43.694609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350387e9-e40c-445a-82bf-37f2a683ffbc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.728613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.729864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.730361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.730833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.732194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:43.733822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:43.735929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 201/392] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:43 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:43.741485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:43.849128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfdab-1430-4b62-9e0a-3c0858ba603b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:43.884898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:43.885775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:43.886056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:43.886353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:43.887540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:43.888984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59e111-cb7e-43f8-a3dc-46fd7982200d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:43.891125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 192/393] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:43 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:43.896504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:44.045876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7943-9472-41bf-a339-4770d79174a5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:44.089555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:44.090470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.090749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.091018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/groups/4f32256fb53542c4832664a9ec3f084f/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.093321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] RBAC: Authorizing `identity:create_grant(project_id=0da49aa012034ca5bbc1ed1bca66a230, group_id=4f32256fb53542c4832664a9ec3f084f, role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:44.094787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9adf71-be2b-4a10-a5bb-5fa37890006a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:44.121791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 202/394] 10.222.0.18 () {58 vars in 1442 bytes} [Sun Mar 20 16:04:43 2022] PUT /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230/groups/4f32256fb53542c4832664a9ec3f084f/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:04:44.613069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2775-61d5-47dc-a3ab-0280b76883c1 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.613906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2775-61d5-47dc-a3ab-0280b76883c1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.613906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2775-61d5-47dc-a3ab-0280b76883c1 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.616003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 193/395] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:44.622644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fcd63-221d-484a-9937-3331872ae6f8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.622936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fcd63-221d-484a-9937-3331872ae6f8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.623213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fcd63-221d-484a-9937-3331872ae6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.645317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-322fcd63-221d-484a-9937-3331872ae6f8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:44.646527 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-322fcd63-221d-484a-9937-3331872ae6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:44.730838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 203/396] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:44.765561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2775-61d5-47dc-a3ab-0280b76883c1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:44.898971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2775-61d5-47dc-a3ab-0280b76883c1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:44.907688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241fd3-f527-4546-9975-8c825ad9bfca None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.908202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241fd3-f527-4546-9975-8c825ad9bfca None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.908305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241fd3-f527-4546-9975-8c825ad9bfca None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.913032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 204/397] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:44.915950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.916237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.916504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.938677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:44.939493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:44.939836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:44.940109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:44.940623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:44.941906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:44.965174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:44.972346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:44.973876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 194/398] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:44.982987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.056477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 205/399] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:45.090805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.141494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253db4-cdbc-4a8c-b859-9c3288f747cd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.186939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.187903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.188450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.188728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.189638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:45.190009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.191418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.203424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 195/400] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:45.210328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.269751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7600-6067-4f10-b2ab-5993cfe4e36e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.311019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.311977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.312256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.312525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.324368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:45.334630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:45.336161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 206/401] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:45.345901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.417923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2ebf-1d00-4627-9220-1b9a84957506 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.464857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981609fb-414f-4e59-9a1a-3e7a82bc297c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.484969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.485857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.486133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.486426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.491011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.492693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.495084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 196/402] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:45.500108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.501917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.502726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.503008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.503279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.504089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:45.504393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.505998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.520776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 207/403] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:45.526732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.619897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47531-ea2e-4cf0-bb38-f6a2e4feeb2b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.672542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.673431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.673711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.673980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.675716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.677150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7e3df-1d07-438c-ad0b-835304d1ff75 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.679205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 197/404] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:45.680418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab17e-4441-460c-8d05-34dc9b5b34cc None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.680698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab17e-4441-460c-8d05-34dc9b5b34cc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.680969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab17e-4441-460c-8d05-34dc9b5b34cc None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.684777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 198/405] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:45.688136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab17e-4441-460c-8d05-34dc9b5b34cc None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.712702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda125-14a0-4d28-9bab-a957933b5c1b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.756856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.758395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.758980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.759759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.761456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.763874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3781ee-6a28-49ea-ab5b-2269c32d93e5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.766788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 208/406] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:45.768204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.768630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.769044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.787775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:45.789249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:45.808957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab17e-4441-460c-8d05-34dc9b5b34cc None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:45.848798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:45.849697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:45.849984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:45.850711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/groups/4f32256fb53542c4832664a9ec3f084f/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:45.852995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, group_id=4f32256fb53542c4832664a9ec3f084f, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:45.855111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:45.867796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 209/407] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:45.868940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:45.880187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 199/408] 10.222.0.18 () {58 vars in 1442 bytes} [Sun Mar 20 16:04:45 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/groups/4f32256fb53542c4832664a9ec3f084f/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:04:45.936052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.029701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434689-4651-4914-bc83-5387db0a12d7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.090709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17b43-458e-4fc8-bf5d-7051eedfc97b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.113280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.114843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.115297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.115741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.117798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.119532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.121497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 210/409] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:46.129577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.162858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.164050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.164506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.164950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.185289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:46.194510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:46.201245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 200/410] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:46.203775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.267148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f8994-6d65-4d2d-9e22-05b9d13557e6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.303630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.305137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.305761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.306546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/groups/4f32256fb53542c4832664a9ec3f084f/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.309024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9977e4ca8345f0be697c1ae7df06e1, group_id=4f32256fb53542c4832664a9ec3f084f, role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.311376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7a565-f760-4257-8832-085fb84660c0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.321046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb857-40bf-46b7-82ea-965a6fd212fd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.330241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 211/411] 10.222.0.18 () {58 vars in 1442 bytes} [Sun Mar 20 16:04:46 2022] PUT /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1/groups/4f32256fb53542c4832664a9ec3f084f/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:46.361965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70beb6-cdc6-4cd7-abe3-4a0b84b0d25f None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.362293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70beb6-cdc6-4cd7-abe3-4a0b84b0d25f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.362567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70beb6-cdc6-4cd7-abe3-4a0b84b0d25f None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.365130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 212/412] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:46.373401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.374022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.374563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.382421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.385657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.388881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.389435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.390481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:46.390988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.393668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.403271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:46.406153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:46.413170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 201/413] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:46.419075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.550921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936adc4-f81b-4504-aa37-91af0e8afee8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.552754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 213/414] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:46.576915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.585643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.586667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.586943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.587212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] PATH_INFO: `/v3/groups/1c5ffce369d14805b31a7d23b833b411` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.589627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] RBAC: Authorizing `identity:get_group(group_id=1c5ffce369d14805b31a7d23b833b411)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.591497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.594051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 202/415] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:46 2022] GET /identity/v3/groups/1c5ffce369d14805b31a7d23b833b411 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:46.599321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.713128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696201a8-62df-4052-af21-83ab0c19ef80 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.724390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b2a1-f3b1-4e7e-876b-094f78e581ed None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.749206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.750496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.750952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.751226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] PATH_INFO: `/v3/projects/c02cce03c9e142bab39baeb17444c822` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.752601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] RBAC: Authorizing `identity:get_project(project_id=c02cce03c9e142bab39baeb17444c822)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.754172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.756442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 203/416] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:46 2022] GET /identity/v3/projects/c02cce03c9e142bab39baeb17444c822 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:46.762092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.792391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.794509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.794793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.795998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.818055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:46.830748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:46.832262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 214/417] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:46.837969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:46.910356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271789a6-76f9-4315-9661-cbdb88d332fb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:46.945918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:46.946835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:46.947111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:46.947385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] PATH_INFO: `/v3/projects/c02cce03c9e142bab39baeb17444c822/groups/1c5ffce369d14805b31a7d23b833b411/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:46.952594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cce03c9e142bab39baeb17444c822, group_id=1c5ffce369d14805b31a7d23b833b411, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:46.954045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:46.975833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 204/418] 10.222.0.18 () {58 vars in 1442 bytes} [Sun Mar 20 16:04:46 2022] PUT /identity/v3/projects/c02cce03c9e142bab39baeb17444c822/groups/1c5ffce369d14805b31a7d23b833b411/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:04:47.030857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefb27-f425-4b8f-a654-14e42b772ca3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.085824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.086502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.086789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.087059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.087820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] RBAC: Adding query filter params (name=member) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:47.088128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:47.089518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a908b-731c-43dc-97a0-ad6059e3a69a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:47.098836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 215/419] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:47.104572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.231459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4958-e981-4246-8e0a-619fec36a858 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.281741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.282430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.282714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.282991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.290062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a538-06ef-4da1-9cea-cb0d1dba3174 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.290386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a538-06ef-4da1-9cea-cb0d1dba3174 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.290635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a538-06ef-4da1-9cea-cb0d1dba3174 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.292716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 216/420] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:47.304067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.304713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.305197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.339181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:47.340298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:47.394650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:47.396678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:47.440656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:47.469339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.536537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 205/422] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:47.542071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.612623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20c2e4-3eec-4569-a6e5-24a35c387152 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.646815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.647637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.647916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.648187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.658919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:47.666576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:47.668132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 218/423] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:47.674783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.728422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd201542-dd15-4751-9cb6-6b8653d6bd63 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.792888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.793756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.794033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.794320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.795588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:47.797075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:47.799114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 206/424] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:47.804431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.845802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d12b-9694-4cf3-a397-58d88892823d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.908309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f615-74bd-404c-be78-4e7b382afe4d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:47.935919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.936602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.936883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.937158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.937910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:47.938213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:47.939604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:47.942965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:47.944150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:47.944430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:47.944697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:47.945965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:47.947903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:47.949940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 207/425] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:47.952616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 219/426] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:47.957885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:47.960901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:48.066035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673904f-4777-40cf-b484-6a4c087c8759 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:48.142808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b430-2c5b-43f2-99eb-48dae2ad00ab None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:48.145717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:48.146407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.146686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.146954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.147782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:48.148084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:48.149511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:48.168628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 208/427] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:48.176823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:48.177493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.177771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.178039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.258420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:48.259922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:48.365323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 220/428] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:48.370757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:48.471371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900bdf6-7582-4e99-97b2-fa4166af1419 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:48.505170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:48.506036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.506341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.506616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] PATH_INFO: `/v3/projects/0da49aa012034ca5bbc1ed1bca66a230` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.507825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] RBAC: Authorizing `identity:get_project(project_id=0da49aa012034ca5bbc1ed1bca66a230)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:48.509264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:48.511275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 209/429] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:48 2022] GET /identity/v3/projects/0da49aa012034ca5bbc1ed1bca66a230 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:48.516860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:48.618094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f12441-29dc-4b74-883d-bfb82203a981 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:48.654491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:48.655380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.655657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.655927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.657125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:48.658649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060568-11ce-4d90-a768-db5f6a1f9282 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:48.660595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 221/430] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:48 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:48.666503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:48.750125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0080-0324-448a-8627-faf9e5cee382 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.750439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0080-0324-448a-8627-faf9e5cee382 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.750612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded0080-0324-448a-8627-faf9e5cee382 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.752671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 222/431] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:48.760276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995dcd-ee0a-43fc-9de6-7cdd44ec4810 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.760828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995dcd-ee0a-43fc-9de6-7cdd44ec4810 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.761294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995dcd-ee0a-43fc-9de6-7cdd44ec4810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.766748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e41d-f952-47da-a520-8a075f654bfc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:48.781161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a5995dcd-ee0a-43fc-9de6-7cdd44ec4810 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:48.782929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a5995dcd-ee0a-43fc-9de6-7cdd44ec4810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:48.803680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:48.804352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:48.804630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:48.804903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:48.806188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=0da49aa012034ca5bbc1ed1bca66a230) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:48.806528 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:48.808242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:48.816554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 210/432] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:48 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=0da49aa012034ca5bbc1ed1bca66a230&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:48.859878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 223/433] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:48.883949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:48.990223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f754f-d345-4efc-8765-a5d6bbd109b9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.028454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.029633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.030118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.030623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.033641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7ee4-238c-4b0a-86cf-91c33dc05584 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.034097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7ee4-238c-4b0a-86cf-91c33dc05584 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.034410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7ee4-238c-4b0a-86cf-91c33dc05584 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.036442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 224/434] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:49.041645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.042117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.042422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.048482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:49.055830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 20 16:04:49.057220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 211/435] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:49.063098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.063603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:49.064836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:49.150902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 225/436] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:49.177873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.183394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81ca03-6b9f-4b1d-827e-c4878465f0e0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.222231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.223221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.223654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.223931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.224700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:49.225008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.226560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.237216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 212/437] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:49.242293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.303119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232354a-2aa0-4ae4-81b4-156f42aeaa9a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.344821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.345806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.346117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.346790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.358947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:49.366226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2031b-baa9-439f-8b8d-22ae5d4ae1b2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.368084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:49.369434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 226/438] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:49.375514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.410751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.411414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.411695 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.411968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.478406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a6a3-556c-4214-9963-112f5b0d858e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.479773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.481278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.516542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.517351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.517631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.517936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.518717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:49.519017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.520388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.528501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 227/439] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:49.534078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.584865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 213/440] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:49.586072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.632944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a81a-4e76-4fd9-a861-7be776d0d8f9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.664115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.664764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.665042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.665313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.684367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af296-201f-4468-b0c1-1d6e4acf7ae1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.716647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.717517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.717849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.718064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.719313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.720754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.722691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 214/441] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:49.727863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.733064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.734541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.820782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c44ea-86cf-42f4-b5b2-4f4678d9d635 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.826949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 228/442] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:04:49.832319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.853442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.854235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.854544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.854817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.855993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.857436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d28f2-ce50-4990-b80d-c98e997eabe9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.859087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 215/443] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:49.859087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939246-3a33-4eaa-898d-1ac9d070c0e7 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.859087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939246-3a33-4eaa-898d-1ac9d070c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.859087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939246-3a33-4eaa-898d-1ac9d070c0e7 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.859087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 216/444] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:49.864938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c939246-3a33-4eaa-898d-1ac9d070c0e7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:49.925872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfea0d-233d-4057-a361-f10df90f19c5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.958118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:49.958999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.959272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.959540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] PATH_INFO: `/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.960691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9977e4ca8345f0be697c1ae7df06e1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:49.962077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c939246-3a33-4eaa-898d-1ac9d070c0e7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:49.962180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bfab2-be0c-4196-a50d-2545c3278866 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:49.963963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 229/445] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/projects/5a9977e4ca8345f0be697c1ae7df06e1 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:49.964876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:49.965151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:49.965417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:49.980491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:49.981644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:49.999680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.000336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.000615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.000888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.001709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=05f5a690bee14e8396c0c920bcf0fb2b, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:50.002014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.003474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.009243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 217/446] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:49 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=05f5a690bee14e8396c0c920bcf0fb2b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:50.015257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.049185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 230/447] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:50.073341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.121512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a290ed-f364-4e83-85bf-41fe28636e42 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.158363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.159489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.159782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.160052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] PATH_INFO: `/v3/groups/4f32256fb53542c4832664a9ec3f084f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.161651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] RBAC: Authorizing `identity:get_group(group_id=4f32256fb53542c4832664a9ec3f084f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.163594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.165760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 218/448] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/groups/4f32256fb53542c4832664a9ec3f084f => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:50.171500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.175347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86e952-2b11-47d3-b611-ea940251bdad None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.210638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.211795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.211795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.212051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.227973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:50.235253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:04:50.236562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 231/449] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:04:50.242588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.280681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18927c56-2b92-4285-843e-e181bf3c6602 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.318965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.319633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.322279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.322279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.322279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] RBAC: Adding query filter params (group.id=4f32256fb53542c4832664a9ec3f084f, role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:50.322279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.322776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.329807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 219/450] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/role_assignments?group.id=4f32256fb53542c4832664a9ec3f084f&scope.project.id=5a9977e4ca8345f0be697c1ae7df06e1&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:50.357164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1268-7b6b-41d3-bf82-6e1056111a87 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.393577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.394185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.394496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.394769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.395546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:50.395848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.397271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.409158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 232/451] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:04:50.415359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.513382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af89e64-09ff-4593-b7b4-32e00fcdc84f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.547706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.548353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.548632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.548896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.620968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.622496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.718608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 220/452] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:50.724480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.822478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47815f4-3870-4301-a67d-c8a8f5b4e7e3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:50.854725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:50.855561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:50.855832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:50.856101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] PATH_INFO: `/v3/projects/c02cce03c9e142bab39baeb17444c822` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:50.857304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cce03c9e142bab39baeb17444c822)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:50.858757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:50.860387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 233/453] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/projects/c02cce03c9e142bab39baeb17444c822 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:50.869498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:50.973633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d06d5-6b36-45ba-99b0-7de93bf9f0ac None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:51.008477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:51.009726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:51.010085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:51.010489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] PATH_INFO: `/v3/groups/1c5ffce369d14805b31a7d23b833b411` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:51.012480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] RBAC: Authorizing `identity:get_group(group_id=1c5ffce369d14805b31a7d23b833b411)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:51.014754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd6c16-56a4-4af7-a864-f70105bd76be None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:51.017271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 221/454] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Mar 20 16:04:50 2022] GET /identity/v3/groups/1c5ffce369d14805b31a7d23b833b411 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:51.026426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:51.129518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db70ac-6038-4ee4-9574-8330e2001786 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:51.162000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:51.162658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:51.162931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:51.163199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:51.164010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] RBAC: Adding query filter params (group.id=1c5ffce369d14805b31a7d23b833b411, role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=c02cce03c9e142bab39baeb17444c822) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:51.164321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:51.165727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b192-dd13-486f-9ae9-d294823079aa None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:51.171390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 234/455] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Mar 20 16:04:51 2022] GET /identity/v3/role_assignments?group.id=1c5ffce369d14805b31a7d23b833b411&scope.project.id=c02cce03c9e142bab39baeb17444c822&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:54.074776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c93e-97c7-4032-93f8-86e84aa120e2 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.075818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c93e-97c7-4032-93f8-86e84aa120e2 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.076296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c93e-97c7-4032-93f8-86e84aa120e2 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.078553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 222/456] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:54.083717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dcca-4df9-439e-96ba-40fc3187da31 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.084562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dcca-4df9-439e-96ba-40fc3187da31 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.085030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dcca-4df9-439e-96ba-40fc3187da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.111211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b216dcca-4df9-439e-96ba-40fc3187da31 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:54.112732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b216dcca-4df9-439e-96ba-40fc3187da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:54.164094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff31bb-7038-4e6a-b30f-d5809a7de7dd None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.164713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff31bb-7038-4e6a-b30f-d5809a7de7dd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.165184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff31bb-7038-4e6a-b30f-d5809a7de7dd None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.168414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 223/457] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:04:54.172605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.173161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.173650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.188185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 235/458] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:54.190884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebf05d-b033-4d2e-b5d2-fd357983f3bb None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.191172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebf05d-b033-4d2e-b5d2-fd357983f3bb None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.191449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebf05d-b033-4d2e-b5d2-fd357983f3bb None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.196992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 236/459] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:54.198595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.198880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.199155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.202025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:54.203468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:54.227326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:54.228512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:54.271684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 224/460] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:54.272862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.330380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 237/461] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:54.330380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.400563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcdc4d-df6e-471c-8153-a4a5bc101b3f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.433847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.434959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.435421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.435861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.438757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fc0de-f956-4bce-8a1a-c447885b56d5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.446596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.448340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.465325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:54.471310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 225/462] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:54.471310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.475279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.476088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.476366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.476633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.486480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.487955 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.504275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e0702229-d5dc-480d-a750-ff092197a466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:54.510023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 238/463] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:54.510023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a323-52e0-41a7-a9a7-bd37203664a1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.510023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a323-52e0-41a7-a9a7-bd37203664a1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.510023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a323-52e0-41a7-a9a7-bd37203664a1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.510377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 239/464] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:54.510994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a323-52e0-41a7-a9a7-bd37203664a1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.567492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4611c8-7381-4f8c-a375-641163a6b6a0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.599840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.600560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.600836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.601103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.605430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a323-52e0-41a7-a9a7-bd37203664a1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.610553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.612191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.629038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:54.634429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 226/465] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:54.634429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.644747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.645413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.645690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.645949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.646721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:54.647014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.648377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e718-9c7c-4b34-a152-aae4106fb7ec None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.659556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 240/466] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:54.660978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.661264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.661536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.677660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:54.678879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:54.733712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c3d3c-2d7c-48da-b304-bd2e8a41c6ca None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.744021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 241/467] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:54.744631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.783791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.784453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.784729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.785000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.785713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:54.786014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.787410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.802735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 227/468] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:54.802735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.850450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc89a0-2e1b-4966-b5d2-5fa38fd49b59 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.884069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.884753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.885037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.885268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.886002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:54.886300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.887682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.892113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f93d9-dd8b-42b6-9e2f-1785e2d0d29c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:54.898578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 242/469] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:54.903163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:54.930889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:54.931554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:54.931832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:54.932116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:54.932876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:54.934341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:54.954238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 228/470] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/users => generated 248 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:54.955543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.017668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bf4fc-6275-4a23-b475-f69911939641 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.053987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.055290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.055721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.056719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.070814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.073315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.091261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:55.093713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 243/471] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:55.094760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.095829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b168-1e7f-4804-bb0d-9819be34db1d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.132151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.133264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.133784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.134325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.135284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.137039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.163586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 229/472] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:54 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:55.164842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.218516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f81e-0b56-46b8-921c-0c24a2240223 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.255229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.256003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.256286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.256559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.257273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.258762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.282149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 244/473] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:55 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:55.291689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b5a7-f768-4ff3-aa1d-e3954a72fe57 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.330824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.331520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.331795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.332105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.332852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:55.333158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.334596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2dd3-2359-4945-a8c9-291b983039f6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.348904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 230/474] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:55.354825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.473070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c406c0c-b9a3-4481-84a6-ea4b56f08f7a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.507916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.508539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.508819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.509081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.509781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.511247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccb436-fa74-4471-98a7-1c33651f1675 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.535061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 245/475] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:04:55 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:04:55.540441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddbb68-3882-487c-8737-aaa69e3f247a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.540730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddbb68-3882-487c-8737-aaa69e3f247a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.540995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddbb68-3882-487c-8737-aaa69e3f247a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.542804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 231/476] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:55.550287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.550636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.550921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.569553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:55.570840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:55.645844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 246/477] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:55.672012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddbb68-3882-487c-8737-aaa69e3f247a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.793607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddbb68-3882-487c-8737-aaa69e3f247a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:55.835178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:55.835846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:55.836122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:55.836391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:55.837150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:55.838605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:55.847802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.sql.core [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 20 16:04:55.847802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 20 16:04:55.847802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [parameters: {'id': '7783ff8fe7bc481a8489f05c4bd16073', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 20 16:04:55.847802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79875) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 20 16:04:55.866489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 20 16:04:55.868316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 232/478] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Mar 20 16:04:55 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:55.874339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:55.985087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7862d-1bbb-416a-ad03-6bc1b188bfcd None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:56.020415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:56.021236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:56.021514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:56.021780 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:56.032891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:56.040369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5c8a3cb5-9879-404f-9926-f3f41effb0d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 20 16:04:56.041847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 247/479] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:04:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:56.047296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:56.164297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2971-44d4-4fd8-bc2e-a9ef751989fc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:56.197513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:56.198234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:56.198552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:56.198875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:56.199633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:56.199935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:56.201327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b565a-fb38-40d0-b887-49711fabbace None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:56.215379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 233/480] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:04:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:57.896381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed721d4-510c-4068-8f6c-cf579f719348 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:57.896903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed721d4-510c-4068-8f6c-cf579f719348 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:57.896903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed721d4-510c-4068-8f6c-cf579f719348 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:57.899024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 248/481] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:57.904379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771589-659d-4993-98aa-60ff8cb72e39 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:57.904790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771589-659d-4993-98aa-60ff8cb72e39 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:57.904952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771589-659d-4993-98aa-60ff8cb72e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:57.922096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d8771589-659d-4993-98aa-60ff8cb72e39 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:57.923306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d8771589-659d-4993-98aa-60ff8cb72e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:57.993013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 234/482] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:58.012707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed721d4-510c-4068-8f6c-cf579f719348 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.115547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed721d4-510c-4068-8f6c-cf579f719348 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.148609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.149335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.149614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.149894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.155585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46289cd-9584-4f22-a134-16cab4fd6bae None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.155862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46289cd-9584-4f22-a134-16cab4fd6bae None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.156135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46289cd-9584-4f22-a134-16cab4fd6bae None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.157898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 235/483] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:58.162983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.163256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.163526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.164521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:58.171694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-4315784d-08c2-49bc-915c-38e75ca92176 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:04:58.173237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 249/484] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:58.174617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669898-3e86-43a7-903a-0cdc60a6ac6b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.174899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669898-3e86-43a7-903a-0cdc60a6ac6b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.175170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669898-3e86-43a7-903a-0cdc60a6ac6b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.177067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 250/485] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:58.182069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.183984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.183984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.188240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:58.189662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:58.201667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:58.202995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:58.274403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 236/486] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:58.276881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.298436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 251/487] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:04:58.299251 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.386766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581405d-de9f-4612-911a-8ba31e00bfef None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.411841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145180-92be-4e3e-a2ce-a9bd94a5486a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.420519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.421482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.421949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.422501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.423452 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:58.423993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.425560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.433863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 237/488] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:58.439427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.444925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.445923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.446378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.446787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.457091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:58.464335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:04:58.465850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 252/489] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:58.467015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.543156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dece4f-e671-43d6-bfeb-5da1ac407134 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.576564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.577703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.578157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.578627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.579952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f092b50-b567-4d3d-a3ae-3aee4bacc896 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.589184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:58.596710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:04:58.598104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 238/490] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:58.599211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.619005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.619845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.620126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.620395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.630950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.632410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.648102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:58.653970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 253/491] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:58.653970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.703231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab44e-509e-4253-b12c-5e8e42402dde None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.740851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.741535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.741955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.742232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.743536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:58.743856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.745223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b7834-0475-439e-a372-9e4955595d07 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.745326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be5be-80db-4eb1-af0e-5b50bc1f3014 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.753787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 239/492] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:58.755118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d837-d01c-4845-bea0-5d3b2adafb84 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.755406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d837-d01c-4845-bea0-5d3b2adafb84 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.755684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d837-d01c-4845-bea0-5d3b2adafb84 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.757450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 240/493] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:58.757981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d837-d01c-4845-bea0-5d3b2adafb84 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.782706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.783416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.783697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.783969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.784714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:58.785023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.786416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.794397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 254/494] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:58.799594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.857190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d837-d01c-4845-bea0-5d3b2adafb84 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.889242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.889906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.890185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.890491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.891212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:58.891515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.893087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea046-9e1b-473f-a875-d39127dc98d4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.902529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8c44a-61cd-44d2-a06f-6fd025324556 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:58.904443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 241/495] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:58.906151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.906151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.906342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.922707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:58.924127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:58.937351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:58.938646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:58.939112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:58.939396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:58.952473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:58.954015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:58.970764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:58.974621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 255/496] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:58.975671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:58.994822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 242/497] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:58.995653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.080083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64b31-81b7-43d0-9028-a14d92b32120 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.088634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b4195-7350-4ea2-93d2-1a4d59b124b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.111182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.112028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.112310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.112580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.121097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.121899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.122178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.122479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.123344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.125370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.129578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.131058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.141465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:59.147576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 256/498] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.147576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.147758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 20 16:04:59.147758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 243/499] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.147758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.245343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1accf3-666c-4651-aa2d-2a538a754c14 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.245535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4011-b4d1-49a5-bd11-86734ca41af0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.277845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.278678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.278958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.279232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.285577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.286627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.287055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.287321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.288043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:59.288340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.289341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:04:59.289702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.296478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:04:59.297679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 244/500] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.298459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.305500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 257/501] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:59.305500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.397838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a6b01-5108-49d7-9031-58cd65ec1d9b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.400669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aea3c-2c16-4fc7-9ef0-db06172ab070 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.428976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.429648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.429931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.430172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.430960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:59.431264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.432613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cfddf-9dd1-4de8-be2a-bb0744860ac2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.435189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.435849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.436126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.436395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.437221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:59.437523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.439011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.443820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 245/502] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:59.445020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869a7c-32b3-4cda-8780-cfc4c3b332ed None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.445303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869a7c-32b3-4cda-8780-cfc4c3b332ed None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.445573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67869a7c-32b3-4cda-8780-cfc4c3b332ed None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.447375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 246/503] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:04:59.447896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869a7c-32b3-4cda-8780-cfc4c3b332ed None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.476540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 258/504] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:59.477116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.545562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67869a7c-32b3-4cda-8780-cfc4c3b332ed None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.569141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0bec-ef23-41fe-b8b7-e3da284f0e6e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.576834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.577489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.577754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.578052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.578827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:04:59.579129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.580544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.588017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 247/505] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:04:59.588852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.602484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.603286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.603558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.603825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.610732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.612217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.625884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-0ffdf84a-1975-4b4c-bb39-735e281b88bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 20 16:04:59.627047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 259/506] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.628162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.628437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.628730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.643935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:04:59.645098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:04:59.681760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42ea9-5bd0-40ae-96d7-9bb423294cac None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.705317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 260/507] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:04:59.706104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.714197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.715388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.715674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.715948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.724819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.726398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.739965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:04:59.741058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 248/508] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.741803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.798361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631bcdc-4308-4d2a-9615-eb9503b8eec0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.829650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.830348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.830627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.830898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.833082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd295836-2f15-4c8d-b8e8-a4b81eb72347 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:04:59.865987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:04:59.866797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:04:59.867074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:04:59.867336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:04:59.877167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.878634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.894737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:04:59.895863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 249/509] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:04:59.896652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.896778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:04:59.898287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:04:59.992202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 261/510] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:04:59.993091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:04:59.995266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322a85-2e3d-4f31-b0c9-9f6408f2326c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.027976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.028633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.028910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.029177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.030003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:00.030303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.031733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.068593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 250/511] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:00.069423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.088229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ac150-1560-4d06-9bd0-c4a708b6273c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.125752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.126560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.126841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.127130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.136827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.138280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.154303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:00.155667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 262/512] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:00.156186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.162984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2f57a-7c36-4f99-930a-bfde6bfe3e1b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.196445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.197110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.197377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.197660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.198544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:00.198851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.200287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.217380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 251/513] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:00.218013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.251581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455700-3440-44fc-ba5b-d3897689a629 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.282419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.283068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.283373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.283643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.284357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:00.284657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.286025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.297387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 263/514] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:00.298152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.317029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391912-ff60-4f87-a9d7-4b0e7e8a78d8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.350241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.351077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.351334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.351595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.361098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.362668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.379231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:00.380382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 252/515] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:00.381112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.390496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb97e4-1054-42d0-b3b6-cb69691cc1d0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.424611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.425260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.425561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.425879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.475782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31033e-59c8-4663-aa0e-0f67b5d6d60f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.487706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.489491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.508610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.509204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.509480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.509750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.510496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:00.510802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.512153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.523409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 253/516] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:00.524191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.581275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 264/517] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:00.582097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.617250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03be29-0386-4126-aeee-c9cb4a498b19 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.648894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.649522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.649798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.650067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.675147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c24c1-e6a7-4c2e-a406-c5600ff0cea1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.706432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.707215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.707491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.707764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.712159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.713593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.714528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.715958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.730214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 20 16:05:00.731391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 265/518] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:00.732129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.810585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 254/519] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:00.810585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.831384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fe94-bb26-4329-b218-be977d0ba68f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.864517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.865164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.865441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.865707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.866517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:00.866820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.868188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.878824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 266/520] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:00.879585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.901809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf69fe-7609-4d39-9e39-eb10b59e48c5 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:00.935031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:00.935700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:00.935983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:00.936254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:00.936961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:00.938448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:00.959247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 255/521] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:05:00 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:00.960050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:00.975262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbb3b8-d878-4867-ae6b-560880d93a10 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.010870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.011681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.011957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.012228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.023936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.025426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.043087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:01.049039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 267/522] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.049039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.065351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436794b-0378-4599-8c54-356b77ae491a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.099787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.100503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.100789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.101065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.102081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:01.102294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.103744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.122926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 256/523] 10.222.0.18 () {56 vars in 1139 bytes} [Sun Mar 20 16:05:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:01.124258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.151015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6b220-87b6-48ae-bc6e-ab94fbe04f01 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.184932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.185979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.186304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.186579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.197867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.199384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.216147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:01.224454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 268/524] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.224454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.234110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47958eeb-b4e9-4071-a2ec-1e767008a8d1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.268515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.269575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.269857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.270129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.276725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.278176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.291006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:01.292193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 257/525] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.292950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.328590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf32d1b-ab61-4323-b712-0f28cff3e826 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.360051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.360717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.361000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.361269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.362068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:01.362397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.364109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.375628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 269/526] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:01.376649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.391711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9d9b-4d9e-413c-b74d-ec40195f8117 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.425070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.426109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.426590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.427038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.474866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2991d5-86c9-4615-b592-e5613bee2525 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.493359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.495089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.509169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.509831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.510116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.510419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.511136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:01.511437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.512800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.523541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 270/527] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:01.524311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.606878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 258/528] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:01.606878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.619256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507b3c-947c-4ba9-8f79-c8d2c8d98870 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.650979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.651646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.651929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.652209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.652992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:01.653298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.654785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.676878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 271/529] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:01.676878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.706034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb3cee-cbd8-4b66-b51f-41f1f3a1b58f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.740591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.741401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.741669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.741939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.748515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.749975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.762723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:01.763920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 259/530] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.764684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.775204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be47fb-6657-4e8b-ae42-85217936f2e8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.811017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.811823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.812104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.812374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.818997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.820441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.833565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:01.839715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 272/531] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.839715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.872873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b17f9-db50-4eaa-ae75-0d28f8079d1d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.907268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.908127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.908414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.908681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.919557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.921018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.937031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:01.942983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 260/532] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:01.942983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:01.943291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3504-2f3f-4f8f-b9b5-3de3568d5ccf None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:01.975785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:01.976532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:01.976878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:01.977212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:01.978089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=ee72038f64224b14bad9e63568c3e316) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:01.978490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:01.979936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:01.990499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 273/533] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/role_assignments?user.id=ee72038f64224b14bad9e63568c3e316&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:01.990499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.046596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5356a4-faed-4554-9629-f2efd6a659c3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.082481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.083251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.083428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.083703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.084504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.084812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.086408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.089296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b576c1-04eb-4440-b74b-f1e3479c1d73 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.108008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 261/534] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.109014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.127745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.129653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.129925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.130193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.131027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.131331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.132800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.152154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 274/535] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.153162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.222922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8183-6e90-4168-a45c-619932b39931 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.251828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36e09-b5fb-47ab-af4f-325d86296ea4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.258718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.259434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.259717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.259992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.260720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.261024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.262429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.273852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 262/536] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.274759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.289089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.289744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.290021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.290326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.291151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=e4d9cf83f9e241549009f2e8b56e5767) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.291451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.292886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.298491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 275/537] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/role_assignments?user.id=e4d9cf83f9e241549009f2e8b56e5767&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.299362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.383228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eedd8-80d8-4b50-a37a-a99f99f50fa9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.398594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03e20-ac10-4308-a1da-145413feafa1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.418175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.418908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.419188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.419501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.420336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.420646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.422100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.428323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 263/538] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.445225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.446060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.446363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.446693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.458112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.459793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.477243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:02.478900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 276/539] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:02.484319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.637892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888cb5e-0c83-4841-bc78-ebb92b6d6e5c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.674760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.675418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.675696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.675966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.676756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.677060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.678520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec0c44-89f9-406d-8a1f-b98bf6c5f811 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.692009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 264/540] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:02.697784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:02.798374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0c6d-82df-4a7d-bad3-75342bd23618 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:02.840059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:02.840730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:02.841007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:02.841278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:02.842109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=cff2fae13e4b40b5b61775a27747fdde) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:02.842438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:02.843888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52f28e-2e76-4647-918d-250fb781f32a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:02.849861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 277/541] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:02 2022] GET /identity/v3/role_assignments?user.id=cff2fae13e4b40b5b61775a27747fdde&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:03.527444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a137d4-ee22-41a9-b344-1971a4c2741e None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:03.527949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a137d4-ee22-41a9-b344-1971a4c2741e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:03.527949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a137d4-ee22-41a9-b344-1971a4c2741e None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:03.529953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 265/542] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:03.535727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:03.536154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:03.536277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:03.556835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:03.558016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:03.628482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 278/543] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:03.667732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a137d4-ee22-41a9-b344-1971a4c2741e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:03.768957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a137d4-ee22-41a9-b344-1971a4c2741e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:03.801932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:03.802768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:03.803045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:03.803312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:03.814098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:03.821572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:03.827827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 266/544] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:03.829249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:03.925847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c85aa-52ed-4cb7-932a-61bfacd7d1b7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:03.960039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:03.960768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:03.961053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:03.961325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:03.962071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:03.962402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:03.963782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:03.976394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 279/545] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:03.977794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:04.075894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc66c-5458-4807-97fd-4b8f3dd9c56f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:04.108676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:04.109529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.109810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.110084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.121187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:04.122686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:04.139689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:04.145508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 267/546] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:04.146888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:04.246871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19895a-318c-410c-b308-6d0673e0fc30 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:04.280439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:04.281137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.281418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.281673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.282450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:04.282754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:04.284200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:04.301453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 280/547] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:04.302822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:04.406132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9516-0684-481f-b036-196963e4ec03 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:04.438920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:04.439765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.440044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.440318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.448358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:04.449818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:04.463689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:04.468196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 268/548] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:04.470936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:04.570300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10993d8-9637-4774-b04e-aa215f0512fe None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:04.603079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:04.603990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.604437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.604854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.605819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:04.606285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:04.607855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ad584-b1e5-4977-b60e-b9b440fbf106 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:04.629911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 281/549] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:04.631715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:04.729289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512635eb-d2ad-4833-8ebd-477607245a8f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:04.762758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:04.763665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.764101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.764524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.787428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1ec-e49e-478d-9107-5cdcf86f022e None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.788059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1ec-e49e-478d-9107-5cdcf86f022e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.788537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a1ec-e49e-478d-9107-5cdcf86f022e None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.798823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 282/550] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:04.804447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:04.805156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:04.805798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:04.834350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:04.836078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:04.850464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:04.851765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:04.946915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 269/551] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:04.949804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.012666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 283/552] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:05.038839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.053368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb16a-3fe6-44dd-9129-5081206f0a7f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.086777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.087579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.087858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.088131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.100226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.101803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.120654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:05.126096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 270/553] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:05.128208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.233261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d54d5-de58-4dcb-b38b-1150cc36e4e9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.269487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.270662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.271158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.271587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.272634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:05.273076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.274640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.293141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 271/554] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:05.294667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.304181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dceaea6-5cec-483e-8d24-d10849bd5b88 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.385193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.386243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.386580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.386823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.398396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:05.404505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b3d8-52d4-486c-98a8-f16f6ec6510d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.405242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-99b79fd7-b0bd-43b2-811c-9a4e82f830af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:05.406828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 284/555] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:05.408479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcad70-5110-4f42-8ed7-5a5f8fb66828 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.408479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcad70-5110-4f42-8ed7-5a5f8fb66828 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.408650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcad70-5110-4f42-8ed7-5a5f8fb66828 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.410533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 285/556] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:05.415130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcad70-5110-4f42-8ed7-5a5f8fb66828 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.448592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.449899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.450613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.452012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.461636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.463973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.482283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-90d881c5-8147-4fe8-a14a-0da094dc856a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:05.489455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 272/557] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:05.489455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.489455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.489455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.510847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:05.512019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:05.536873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcad70-5110-4f42-8ed7-5a5f8fb66828 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.573137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.573908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.574128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.574453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.575201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:05.575673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.577209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.589961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 273/558] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:05.589961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.590604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 286/559] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:05.595329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.705473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fe4d-5a86-4201-ac25-f6ba61c1ccc9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.712456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117b68-d68f-4e05-8b64-ae7fc4153cc2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.745789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.746200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.746892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.747169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.747439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.747705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.748166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.748266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:05.748546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.748867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.749982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.759562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.761030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 274/560] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:05.761433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.761941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.781358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8c902d0e-4123-42eb-9786-ad70aefa619e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:05.782908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 287/561] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:05.784208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8568e-321b-46d7-9af1-de8853ecbd36 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.784489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8568e-321b-46d7-9af1-de8853ecbd36 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.784757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8568e-321b-46d7-9af1-de8853ecbd36 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.786566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 288/562] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:05.787304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8568e-321b-46d7-9af1-de8853ecbd36 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.866248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd612ec-a669-4924-adaa-50a46e96b296 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.881960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8568e-321b-46d7-9af1-de8853ecbd36 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:05.899122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.899924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.900202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.900474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.910442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:05.917447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:05.918462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:05.923392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 275/563] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:05.923519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.923519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.923646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:05.923713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.923713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c8dbf02e3130431c9bc3a95a97e039c7) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:05.923713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:05.923713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221adfa-b359-480a-9f1e-dc2ed7a858b9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:05.927530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 289/564] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/role_assignments?user.id=c8dbf02e3130431c9bc3a95a97e039c7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:05.928677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756391-0b12-4c36-a57c-48a0f7b8c538 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:05.928954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756391-0b12-4c36-a57c-48a0f7b8c538 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:05.929222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756391-0b12-4c36-a57c-48a0f7b8c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:05.948890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-02756391-0b12-4c36-a57c-48a0f7b8c538 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:05.950973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-02756391-0b12-4c36-a57c-48a0f7b8c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 290/565] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055953-e424-4af1-9c9e-837c07b64a63 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055953-e424-4af1-9c9e-837c07b64a63 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055953-e424-4af1-9c9e-837c07b64a63 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 291/566] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:06.027372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5055953-e424-4af1-9c9e-837c07b64a63 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.043464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6dac-a3f7-4875-a552-0d11d7dc769e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.081603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.082278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.082580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.082833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.083561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.083862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.085254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b828c1a-8466-414b-b6d1-ab92b2e3d49d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.098562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 276/567] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.099873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.100160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.100432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.117780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:06.119011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:06.138705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5055953-e424-4af1-9c9e-837c07b64a63 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.170511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.171525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.171525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.171692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.172492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.172752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.174097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.186634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 292/568] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.186634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.188587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 277/569] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:06.192106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.282976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9423c-8a24-4648-8fc0-ba62002282a3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.295356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d88fe-846e-4489-a9ac-2878e45451dd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.315008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.315814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.316093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.316364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.326375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:06.330564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.331362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.331636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.331905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.333302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:06.334817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 293/570] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.335591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.343660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.345314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.359375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 20 16:05:06.360547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 278/571] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.361293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.437301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ed09-7697-475c-baba-f8ee5e05e2e9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.456325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058035a-4522-4b94-8797-a23d2dc4c3a6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.469784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.470836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.471314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.471585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.481683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.483194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.489120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.489942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.490215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.490519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.499662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:06.500508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:06.500828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 294/572] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.501587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.508112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:06.509427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 279/573] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.510315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.598302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddd60c-79c3-4663-aff6-9866eac16795 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.611645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee12a-07c5-4e87-b33d-2df39004c79f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.631741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.632413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.632699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.632975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.633724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.634031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.635463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.643143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 295/574] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.644107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.645333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.646107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.646525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.646894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.648271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.649223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.650011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.667357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 280/575] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.668179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.744055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c556-68f0-432e-8739-82dcc4d2d44b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.770840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fb74-9dad-4682-b341-13b7212878eb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.776963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.777635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.777947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.778186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.778969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.779273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.780642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.796574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 296/576] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.796574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.810950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.811623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.811902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.812173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.812920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:06.813221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.814659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.827443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 281/577] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:06.827443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.897678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc70aa-d6f2-4bab-a0d0-4e7dee738941 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.921555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ccdcb-d5b6-4342-ac68-ee88cc802fba None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:06.929729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.930747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.931182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.931450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.941450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.943085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.953732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:06.954566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:06.954851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:06.955167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:06.960550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:06.966059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 297/578] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.966059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:06.968954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:06.970465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:06.986654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:06.992553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 282/579] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:06.992553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.074246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438472-d4c9-40b3-b158-1ba964bbefe2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.091191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b30b-b465-4d5f-97a9-6f095fe3155e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.105621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.106446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.106726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.106996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.114617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.116060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.125543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.126543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.127089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.127508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.129226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:07.134786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 298/580] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.134786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.143831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.145333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.161933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:07.167435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 283/581] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.167435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.232565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e111-a017-4802-b255-9c9524824d45 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.264440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.264625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee120b6-a799-4a42-9927-24ef3b2b1b90 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.265102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.265379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.265647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.266397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.266708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.268167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.279553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 299/582] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.280650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.305204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.306035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.306349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.306939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.307934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.308244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.310370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.322134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 284/583] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.323045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.376377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663781-fc90-4a7c-a012-fa3c67024910 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.409289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.410185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.410499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.410772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.411606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.411914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.413394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.416451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8cf3-8b11-49f9-95bb-77d7d5dc81d7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.434309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 300/584] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.434965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.448722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.449625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.450119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.450405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.451116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.451412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.452764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.464189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 285/585] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.469180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.536491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418d049-3b68-4d81-ab9d-a7acdf316bed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.567691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8481-9709-4ca9-906c-e7e836d4b010 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.571894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.572719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.572999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.573270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.583203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.584838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.598866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 20 16:05:07.604999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 301/586] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.604999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.605615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.606456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.606745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.607128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.615035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.616487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.629955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:07.631381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 286/587] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.631922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.707036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e030d-0163-4314-b1c5-7fb798d2307e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.726900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80fd6-2f5b-43c8-9593-d824cbb1be96 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.739205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.739997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.740288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.740557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.750750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.752263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.759932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.760763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.761017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.761294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.768435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.768906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:07.769881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.774714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 302/588] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.774714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.788815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 20 16:05:07.794668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 287/589] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:07.794668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.876910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b723-e195-4509-aec2-9680d6b70760 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.890932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc433-aa37-4879-b4b4-4c3a4200fef0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:07.910701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.911392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.911673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.911947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.912783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.913089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.914567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.924744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:07.925395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:07.925679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:07.925954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:07.926767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:07.927074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:07.928796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:07.941834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 303/590] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.941834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:07.945092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 288/591] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:07.950688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.047315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68f38-caa3-474b-aaf4-995aa76a655f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.047545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8318ee-c526-4197-939a-42f14d87910e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.080141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.080377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.080823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.080990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.081082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.081226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.081386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.081531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.082175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:08.082291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:08.082524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.082629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.083889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.083981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.099364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 304/592] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:08.099364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.106552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 289/593] 10.222.0.18 () {56 vars in 1139 bytes} [Sun Mar 20 16:05:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:08.107580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.194510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda03a1-573e-4516-a851-0e363e7a7657 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.212364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda3ee-621a-4497-89d3-639340867118 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.228573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.229405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.229681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.229949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.240364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.241810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.245127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.246013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.246314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.246587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/ee72038f64224b14bad9e63568c3e316/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.257274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:08.258783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 305/594] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:08.259624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.260380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=ee72038f64224b14bad9e63568c3e316, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.261819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.275051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 290/595] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:08 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/ee72038f64224b14bad9e63568c3e316/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:08.276030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.361626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515648f-4ca3-4b59-820f-5fad7bcdaf33 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.380722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d78e29-4de4-4d91-9662-8e285194d0ac None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.396512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.397326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.397604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.397874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.405093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.406619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.416044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.416845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.417119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.417385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.421900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-111aa28b-76c4-49cc-b954-b170e8927ea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:08.427980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 306/596] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:08.427980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450489df-e60e-43a2-b2db-751385598b66 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.427980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450489df-e60e-43a2-b2db-751385598b66 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.427980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450489df-e60e-43a2-b2db-751385598b66 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.427980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 307/597] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:08.428836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450489df-e60e-43a2-b2db-751385598b66 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.432709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.434193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.451773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:08.453000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 291/598] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:08.453766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.537922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450489df-e60e-43a2-b2db-751385598b66 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.552382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92934-bb7c-42f5-b814-8abd5767d0f1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.570768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.571436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.571715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.572005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.572696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:08.572994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.574392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72567793-afc9-49d9-b2d9-d72c75fa1597 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.585519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.585840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 308/599] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:08.586230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.586541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.586882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.587764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:08.588095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.588324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.588781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.589233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.589530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.601983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 292/600] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:08.602899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.607497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:08.608664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:08.676484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 309/601] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:08.677632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.700184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d211bb-23d5-4fee-b009-6b0d74808920 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.732331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.732997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.733279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.733554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.734298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:08.734610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.735981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.747648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 293/602] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:08.748396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.783625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9d45a-87f1-4163-bf3b-74a0f5696be6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.817582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.818405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.818683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.819058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.825349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.826807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.839312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:08.840456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 310/603] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:08.841202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.850277 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ea07a-adaf-41f7-85a6-c966f3557978 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.885555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.886428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.886714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.886988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.901273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=8c61a24263474ff7926d416bedf11db7, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:08.902767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:08.927103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 294/604] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:08 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:08.928272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:08.943378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5087-d0eb-40f5-8bae-a6c65cd04318 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:08.979840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:08.980658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:08.980940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:08.981214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:08.992941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:09.000281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:09.002167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 311/605] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:09.002784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.060147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fba8e-727e-4688-905c-892082a45076 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.100946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.102633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.103385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.103871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.105204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2504-55bc-4d48-bd44-d3d8988dd5fd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.112113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.113611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.131697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:09.133870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 295/606] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:09.134833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.144173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.145160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.145642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.146599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.147604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:09.148125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.149634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.166291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 312/607] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:09.166291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.272251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214956-0729-47c4-9d81-7dc6067aa3af None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.281389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c3494-4b1e-4625-ac86-4a89b5e495f7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.306896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.307930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.308432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.308909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.309870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:09.310409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.312209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.314608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.315273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.315552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.315824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.316604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:09.316908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.318341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.323048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 296/608] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:09.324144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.342336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 313/609] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:09.343269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.425470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d8b3-9112-451f-9334-c69ffd2f5f46 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.444047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655d2f-3559-446c-b8aa-add4981d9487 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.459480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.460585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.461017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.461431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/e4d9cf83f9e241549009f2e8b56e5767/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.476388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=e4d9cf83f9e241549009f2e8b56e5767, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.477663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.478372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.478688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.479058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.479442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.491590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.493306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.506458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 297/610] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:09 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/e4d9cf83f9e241549009f2e8b56e5767/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:09.507727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.511400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:09.517333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 314/611] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:09.518729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.619823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd157f4-0fc2-4d89-b912-3aca79263619 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.658300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.660084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.660757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.660757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.661365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:09.661667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.664173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.694707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 315/612] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:09.700211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf31ca-8700-4b24-ade1-39c9d2f9a540 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.710344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:09.776057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.776968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.778378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.778378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/cff2fae13e4b40b5b61775a27747fdde/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.799707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=cff2fae13e4b40b5b61775a27747fdde, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.801158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.821030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 298/613] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:09 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/cff2fae13e4b40b5b61775a27747fdde/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:09.832879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04b39c-34a8-4760-81ff-22f66b1b70f3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:09.878398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:09.879217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:09.879489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:09.879755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:09.894309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:09.895781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:09.910844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:09.912449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 316/614] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:09.923045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:10.052396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bfc8-a04e-4b82-9bec-544ac9b9a29d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:10.090029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:10.090753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.091029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.091299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.092131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:10.092433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:10.093853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:10.111647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 299/615] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:10.118400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:10.250605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8493f-7e7b-4db3-a8f0-8a0c6e8640ed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:10.294709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:10.295532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.295810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.296079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.313852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:10.315335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:10.337817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:10.343468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 317/616] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:10.349128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:10.500683 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4b19-f1f3-48d4-a9d4-b6fa739c62af None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:10.545606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:10.546285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.546568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.546838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.547555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:10.547851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:10.549245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:10.564195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 300/617] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:10.569599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:10.665125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e077-45d0-4331-b21d-055919dc87d3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:10.697590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:10.698423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.698693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.698957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.705573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:10.707038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:10.720263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8af8059e-63d4-41c0-b466-9673e5422a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:10.721796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 318/618] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:10.727348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:10.824869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8334c-a760-47c2-be0d-66eadb22125c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:10.833248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a01e-9b02-4a01-8f24-ba4577d9f119 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.833248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a01e-9b02-4a01-8f24-ba4577d9f119 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.833248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a01e-9b02-4a01-8f24-ba4577d9f119 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.833886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 319/619] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:10.839311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.839836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.840332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.857470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:10.859343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:10.860228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:10.860940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:10.861217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:10.861550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:10.862388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:10.862879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:10.865432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:10.881067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 301/620] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:10.890293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.011890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 320/621] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:11.026049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc4b0-252c-4d5d-8fee-1914fe38f1ea None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.040772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.102535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.103349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.103625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.103896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c8dbf02e3130431c9bc3a95a97e039c7/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.128384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=c8dbf02e3130431c9bc3a95a97e039c7, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:11.131770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:11.156326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 302/622] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:10 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c8dbf02e3130431c9bc3a95a97e039c7/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:05:11.183607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e20eb-d327-4d62-bb6b-5e95d2eeb505 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.228491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.229396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.229677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.229944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.240624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:11.247878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:11.249490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 321/623] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:11.259446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.382508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6ed55-022b-493a-ab72-abcd32b69f40 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.419028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.419696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.419977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.420250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.420994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:11.421346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:11.422763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a13014-8d7e-4c6f-9c26-1c1f9328346b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:11.431169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 303/624] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:11.437785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.449749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154376-6021-4b23-b56f-5cde71d39d8d None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.450074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154376-6021-4b23-b56f-5cde71d39d8d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.450344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154376-6021-4b23-b56f-5cde71d39d8d None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.460117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 304/625] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:11 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:11.463355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.463699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.463975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.494961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:11.496182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:11.581550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793b01-ba72-4289-9853-7a5796128889 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.586496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 305/626] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:11.615733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.616532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.616805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.617072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.622138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.647720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:11.649131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:11.689358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:11.690402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 322/627] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:11.695937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.743735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36cd37-6e35-4b04-b186-3fc542c6276e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.776724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.777439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.777712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.777978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.788438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:11.795385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:11.796884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 306/628] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:11.797094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea22e-791b-4961-9b91-536e508df80c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.807280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.839365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.840047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.840328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.840599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.841323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:11.841622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:11.843596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:11.855084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 323/629] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:11.860430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.907317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5538e-6b96-42dd-bb5e-2f89ce790286 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.955944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.957024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.957537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.957920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a053994-8440-46c1-94bc-e656622800cc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:11.958246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:11.959243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:11.959746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:11.961303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:11.976715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 307/630] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:11.982099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:11.996435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:11.997229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:11.997510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:11.997785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.005248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.006723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.020597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 20 16:05:12.022072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 324/631] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:12.027503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.124938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5685-157d-47aa-983b-36f174323d31 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.159931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.160531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.160808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.161080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.161923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:12.162223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.163692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.181347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 325/632] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:12.186796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.199824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946ba2-6c7a-48fb-b27c-9b382c70b826 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.261642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.262480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.262760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.263032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.287065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.288541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.317351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:12.318603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 308/633] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:12.330453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.377787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ca2a-b23d-4fb0-9dcd-f5413d9e1516 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.424309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.425297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.425779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.426271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.514726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.517036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a588314-90f5-4551-a443-e14448d0d810 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.533803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a699-1063-42d7-a9b0-1f98cca9dfc9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.580241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.580849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.581132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.581408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.582132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:12.582462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.583834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bee0-3e7b-4fe4-bd5e-566400d44c52 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.596232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 309/634] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:12.597677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885b91-c514-4e88-a999-92133791ea5b None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.597966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885b91-c514-4e88-a999-92133791ea5b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.598242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885b91-c514-4e88-a999-92133791ea5b None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.604024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 310/635] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:12.605099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02885b91-c514-4e88-a999-92133791ea5b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.632892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 326/636] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:12.634530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.635007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.635484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.656770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:12.658679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:12.714634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02885b91-c514-4e88-a999-92133791ea5b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.733864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 327/637] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:12.734535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.754413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.756322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.756881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.757164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.768164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.770520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.788203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-da6104a7-b026-4e06-ab22-d68698f69e4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:12.790151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 311/638] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:12.794313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaba84a-577b-47a4-b970-ea383cd7be15 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.794313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaba84a-577b-47a4-b970-ea383cd7be15 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.794313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaba84a-577b-47a4-b970-ea383cd7be15 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.795383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 312/639] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:12.796335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaba84a-577b-47a4-b970-ea383cd7be15 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.830569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ba4e-2740-40d8-adae-b745da887e68 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.863444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.864559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.864830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.865091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.874970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:12.876404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:12.892636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:12.898447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 328/640] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:12.898582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaba84a-577b-47a4-b970-ea383cd7be15 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:12.898676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:12.927611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:12.928437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.928715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.928985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.938970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:12.945994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-29cfe483-4a95-40ea-9acb-05f237b09aec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:12.951919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 313/641] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:12.951919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:12.951919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:12.951919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:12.965172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:12.966289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:12.998918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2102ad-0a07-4ea1-90dc-8a579f52500e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.030851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.031512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.031786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.031943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 314/642] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:13.032767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.038578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.039676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.040398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.042039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.059718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 329/643] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.060586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.130560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732767c-3e87-4870-9182-0afe8bc6ce97 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.155327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ef71b-5826-429f-8395-68bc21237661 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.163237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.163920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.164199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.164476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.165196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.165503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.166919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.178229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 315/644] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.179138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.193040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.193800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.194082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.194377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.195140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.195426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.196798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.209884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 330/645] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.211267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.282317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bd6e1-ba12-42c0-8e7a-4479c9940b69 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.308264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d67c4-ae9f-4e35-be9b-dd26d8a2f165 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.323406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.324217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.324497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.324769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.335405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:13.341716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.342400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.342681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.342837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:13.342989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.348904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 316/646] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:13.348904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.407163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.408779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.445163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2331-3ccd-4db9-822e-a957a316bf40 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.477480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.478601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.479054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.479531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.486343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.487787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.504470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 331/647] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:13.504470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.504702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:13.504702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 317/648] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:13.504702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.607516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b63d4-e88e-40d6-b41c-8f4a2ce5615b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.610467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5435292-2f49-4f8f-8e5f-a6cce171ce04 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.642875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.643219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.643552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.643830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.644003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.644095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.644237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.644500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.644841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.645146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.646543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.654297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.659633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 318/649] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.659633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.659814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.676264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:13.677439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 332/650] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:13.678194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.761245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f000c6-acfe-41aa-b87f-9de783fc2ec4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.775523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f86e-f9d6-4514-8fcf-05323648767d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.795067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.795899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.796181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.796451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.808591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.810052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.811570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.812250 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.812536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.812813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.813605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.813914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.815453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.826802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:13.836488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 333/651] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.836488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.836697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 319/652] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:13.836697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.933572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2a5cc-0c88-4d88-b0bb-60cac052a169 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.935004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5e13-3302-4215-bbed-98e291ea7ba4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:13.966768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.967423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.967703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.967971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.968688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:13.968989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.970376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:13.975102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:13.975902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:13.976181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:13.976456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:13.981522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 320/653] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:13.982319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:13.987031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:13.988494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.005637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:14.006837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 334/654] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:14.007605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.082878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02e2d8-ee72-4132-b244-9b3050656bb9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.110697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea140-be21-44d4-a124-a66bb3804f0a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.116367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.117018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.117296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.117566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.118414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=ee72038f64224b14bad9e63568c3e316) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.118720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.120144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a4ad9-0ef6-4853-ab4c-6da9620d1760 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.125878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 321/655] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:13 2022] GET /identity/v3/role_assignments?user.id=ee72038f64224b14bad9e63568c3e316&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.127121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c2432-3159-41f6-96ed-9343b29d584a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.127390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c2432-3159-41f6-96ed-9343b29d584a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.127677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c2432-3159-41f6-96ed-9343b29d584a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.133310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 322/656] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:14.133310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c2432-3159-41f6-96ed-9343b29d584a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.146657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.147336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.147612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.147881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.148601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.148913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.150336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.163363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 335/657] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.168628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.251862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c2432-3159-41f6-96ed-9343b29d584a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.272321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a29675-88b9-4fd0-832d-f1f850e31141 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.286647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.287460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.287733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.287997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.295573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.297035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.306770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.307440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.307685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.307983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.308909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.309215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.310603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.311570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-b914635a-536b-42b0-a4c9-49d72173d89a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 20 16:05:14.317490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 323/658] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:14.317490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.317490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.317490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.333237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 336/659] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.334403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.342128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:14.343400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:14.413499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 324/660] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:14.414714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.446273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc0b06-8e0d-45b8-be3e-0ee3f8ef3b5d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.478146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.479214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.479670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.480081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.487083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.488522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.504943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:14.511513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 337/661] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:14.511513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.511744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123363c4-187c-4dcd-a2bc-ebf6cc5fd2f9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.543411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.544139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.544412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.544727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.545560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.545860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.547322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.565557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 325/662] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.566409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.610571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87367-f263-4b87-bbf0-0b908391ae89 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.642073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.643077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.643419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.643753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.650976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.652525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.665618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 20 16:05:14.666801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 338/663] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:14.667566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.673700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8008-2528-4e70-b15c-00aa960802cd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.706603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.707396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.707669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.707933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.717544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:14.724535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:14.730442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 326/664] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:14.730442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.762862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232cda-9ac8-4817-9e82-4b878db92f56 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.794162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.794895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.795116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.795386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.796724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.796724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.797881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.809383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 339/665] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.810025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:14.830289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da038-efc7-4589-95a4-6f48c78fb4c9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.870088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.870771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.871051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.871324 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.906951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b315908-7710-48c8-a10e-c34d7fc78595 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:14.935996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.937441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.941581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:14.942506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:14.943154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:14.943621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:14.944648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:14.945206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:14.946843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:14.963417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 340/666] 10.222.0.18 () {56 vars in 1139 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:14.964531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.037423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 327/667] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:15.037423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.073905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616fce2-b905-4e73-93b6-8a0760abc5f6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.115207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.115923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.116466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.116741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.117650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:15.118247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.120018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.127788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972c75-73ae-4e40-a3c5-1bb6597e185b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.132534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 341/668] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:15.132534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.164858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.165517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.165792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.166065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.166921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:15.167229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.168685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.182475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 328/669] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:15.182475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.251757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f98e-c18e-4240-8d52-0d900de2291d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.287928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.288849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.289132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.289402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.314283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488214-6a04-44a7-bfcc-de5014164d13 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.362672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.363251 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.363651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.364306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.364661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.365065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.378520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.379374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.398394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:15.399748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 329/670] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:15.400352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.482189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 342/671] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:15.483313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.518032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068c27-45bc-40a7-92d7-5091a385f57d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.555414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.556132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.556405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.556675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.566911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.568342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.584965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:15.586470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 330/672] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:15.587243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.593590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6542046-2bbb-4d35-a36a-c281c89c5e6e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.634372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.635343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.635621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.636144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.636873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:15.637176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.638994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.652291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 343/673] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:15.657413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.691833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924dece-8460-42f9-af16-283718888ac4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.725533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.726391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.726672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.726962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.737377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.739193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.756399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:15.757965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 331/674] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:15.758861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.783227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdc9e-9c73-441d-bab3-486b7db963c1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.815902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.816617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.816987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.817348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.818158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:15.818592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.820043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.836206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 344/675] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:15.837197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.855143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f200a4-24af-4d21-a1d3-007e9f588e90 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.888463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.889253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.889534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.889809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.896582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.898033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.911055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:15.912581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 332/676] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:15.913355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:15.937859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf11c-3085-45db-8e17-5b3fd6a8b74c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:15.971007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:15.971720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:15.971940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:15.972211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:15.972922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:15.973220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:15.974599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:15.986138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 345/677] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:15.987022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.011050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2dbf1-2415-4599-a528-b74da3048aa2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.049783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.050881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.051166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.051447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.061674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.063318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.080456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:16.081612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 333/678] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:16.082408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.104863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef55b-5059-4e5a-9e9d-a4f824e75219 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.143839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.144516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.144795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.145066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.145854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:16.146159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.147626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.164951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 346/679] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:16.165960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.216042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38fe5-8259-46e5-9768-94079240ef42 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.250247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.251077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.251358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.251630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.258828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.260339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.274065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:16.275054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a44e5-7447-4772-8866-ccdc418befdc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.275676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 334/680] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:16.276519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.307404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.308074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.308348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.308613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.309429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:16.309727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.311201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.328671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 347/681] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:16.329599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.375028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466eb3e-0e7c-4c4a-9939-37887c53705e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.408774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.409487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.409771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.410048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.410933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=e4d9cf83f9e241549009f2e8b56e5767) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:16.411243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.412685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.424452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf0606-f01b-4b97-b30b-793abc2d285a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.426430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 335/682] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/role_assignments?user.id=e4d9cf83f9e241549009f2e8b56e5767&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:16.427442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.466057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.467075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.467480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.467882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.469091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:16.469565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.472147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.488231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 348/683] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:16.495629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.617450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f636463-0b6f-4073-9cda-02cb7eaa88c8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.631708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e1a0-8f32-4bfd-af5c-d019f3730473 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.653281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.653943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.654215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.654514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.655343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=cff2fae13e4b40b5b61775a27747fdde) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:16.655644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.657068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381f0d5-eb7a-48d8-acaa-0f065c51eb00 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.666147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 349/684] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/role_assignments?user.id=cff2fae13e4b40b5b61775a27747fdde&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:16.667847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc2cd-817c-44f6-9274-269fbe60284d None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.668139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc2cd-817c-44f6-9274-269fbe60284d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.668417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc2cd-817c-44f6-9274-269fbe60284d None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.670244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 350/685] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:16.676043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.676346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.676588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.691059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.692152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.692646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.693113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:16.695482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:16.695951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:16.783375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:16.784876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:16.793577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 351/686] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:16.823322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.902306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 336/687] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:16.907829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:16.958173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb41ea-c00e-40f9-bb80-c023c6fcab19 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:16.995403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:16.996557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:16.997044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:16.997499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.008027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec74a07-2669-4df9-8e84-5432b46557a9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.008830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.010507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.027851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:17.029658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 352/688] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:17.037806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.047980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b03de-2954-40da-b521-d4642da231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.048845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b03de-2954-40da-b521-d4642da231fc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.049127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b03de-2954-40da-b521-d4642da231fc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.049403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b03de-2954-40da-b521-d4642da231fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.059969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b03de-2954-40da-b521-d4642da231fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.061508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b03de-2954-40da-b521-d4642da231fc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.079011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-487b03de-2954-40da-b521-d4642da231fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:17.084756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 337/689] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:17.085982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b03de-2954-40da-b521-d4642da231fc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.138107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d236-fcc9-4361-9ea5-4708abdf31d5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.179047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.180043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.180511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.180967 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.181890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:17.182404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.183845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b03de-2954-40da-b521-d4642da231fc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.184213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.200870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 353/690] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:17.207375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.230559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.231295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.231577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.232350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.233089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:17.233390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.236691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.264866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 338/691] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:17.266046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.384669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f831f-f791-4f32-b806-e0da5b016e59 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.424264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.424940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.425216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.425483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.426179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.427651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.469918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f326a38-b5a4-49a9-8369-577498870f64 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.471259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 354/692] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:05:17 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:17.509966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.510829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.511107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.511380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.519193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.520660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.538524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:17.540197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 339/693] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:17.545813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.683408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9ca3-9e01-4854-b13e-abd78c4e5c3d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.716529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.717205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.717484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.717759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.718570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:17.718882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.720441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc932ce-5de8-483b-9d41-1b6163d716dc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.733119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 355/694] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:17.739296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:17.789880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed500-6972-43c5-9f5d-3b29a4e36a34 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.790205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed500-6972-43c5-9f5d-3b29a4e36a34 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.790478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed500-6972-43c5-9f5d-3b29a4e36a34 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.793505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 356/695] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:17.797628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.797913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.798190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.818318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:17.818318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:17.891084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1cb2b-6833-4f85-bb81-6ae411903b14 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:17.911186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 357/696] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:17.937255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:17.937916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:17.938196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:17.938499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:17.939387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c8dbf02e3130431c9bc3a95a97e039c7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:17.939698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:17.941197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:17.949804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 340/697] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/role_assignments?user.id=c8dbf02e3130431c9bc3a95a97e039c7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:17.971268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:18.092273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b240934-88ce-42de-bb78-0a6f0e953b7a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:18.144109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:18.144918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:18.145257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:18.145532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:18.156125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:18.163132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:18.169266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 358/698] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:18.170746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:18.303355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1565-aae8-499f-a2ce-2ff4d411b5fe None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:18.342890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:18.343956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:18.344428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:18.344900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:18.345874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:18.346407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:18.347974 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:18.357158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 341/699] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:18.362421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:18.461131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223cf6-a085-484d-9d1f-22cba9273e64 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:18.494901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:18.496040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:18.496513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:18.496974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:18.507191 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:18.508928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:18.525763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:18.527522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 359/700] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:18.535378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:18.645031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033cb95-3a3f-47f6-b7e8-e691e1bc9167 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:18.679639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:18.680307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:18.680589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:18.680859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:18.681652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:18.681953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:18.683492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:18.699935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 342/701] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:18.707332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:18.809838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd466-6101-49bc-9cf2-e46ecae3d6ed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:18.847701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:18.848572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:18.848859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:18.849131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:18.861804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:18.863286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:18.881271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:18.886711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 360/702] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:18.892818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.040882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5c4a3-8b73-4ce7-b3b8-8d0e8e6e0b3d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.083967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.084652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.084932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.085204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.086046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:19.086377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.087810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5b32c-78f8-448d-86f7-42ebff30a324 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:19.105797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 343/703] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:19.111331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.268415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25d12-10b4-46bf-aa77-c73f07ad2205 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.268759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25d12-10b4-46bf-aa77-c73f07ad2205 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.268975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25d12-10b4-46bf-aa77-c73f07ad2205 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.271037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 344/704] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:19.271744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12799-234b-49e7-8084-b59c9f0ba7ed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.277963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.278268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.278546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.308826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.309406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.309682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.309950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.311243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:19.312433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:19.404117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.405577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:19.437172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 345/705] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:19.470836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.537063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 361/706] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:05:19.539541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.641198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec8c44-d6b8-4107-bfe6-9c541522955c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.669549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5302e-e169-44c4-ae86-44538749fe99 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.683583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.684701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.685168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.685641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.695998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.697718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:19.709290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.710111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.710415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.710688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.711341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.712703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:19.716258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-78e9338d-eee1-4b5c-b176-73ee31c2aed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:19.717953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 362/707] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:19.719550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657199-ee5a-4b36-bdb9-137fffd833e6 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.720024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657199-ee5a-4b36-bdb9-137fffd833e6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.720481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657199-ee5a-4b36-bdb9-137fffd833e6 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.722369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 363/708] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:19.723247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657199-ee5a-4b36-bdb9-137fffd833e6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.726287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-d8ecd841-3194-441c-bb3a-d70a55e6779b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 20 16:05:19.728609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 346/709] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:19.729805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.730086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.734435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.752458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:19.754037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:19.827733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657199-ee5a-4b36-bdb9-137fffd833e6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.834546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 347/710] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:19.835680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.875860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.876908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.877375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.877865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.878776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:19.879214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.880751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:19.898162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 364/711] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:19.899039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:19.956624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582b544-df30-4560-8e69-f1e884cee4a2 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:19.992395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:19.993337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:19.993735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:19.994012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:19.994804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:19.995115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:19.996501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.006054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 348/712] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.007022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.027275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa628-6342-4a35-a4e5-7d9e789c0968 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.060613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.061420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.061699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.061973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] PATH_INFO: `/v3/services/network` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.062690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.064100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.077018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 20 16:05:20.083342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 365/713] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:19 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:20.084214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.124930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371c61-c398-4efe-9f5f-54a3000a0312 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.163992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.164788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.165071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.165788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.174928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.176385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.188556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a2d3-0b93-4a8d-a41d-1de580dccd55 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.193204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:20.198359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 349/714] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:20.199183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.236207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.236679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.236959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.237232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.237942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.238322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.239960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.250568 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 366/715] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.251583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.332774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3aa1-faf3-46a6-aa02-0258d37a6207 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.362586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7e56-084e-4134-b1bd-0742f3d4bfb4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.378497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.379179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.379473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.379733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.380483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] RBAC: Adding query filter params (name=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.380749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.382220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a39096-fb77-4987-90b0-9f4a620d0da2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.391559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 350/716] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.393327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bccb2-487a-4632-8caf-7d638e4bf44e None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.393619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bccb2-487a-4632-8caf-7d638e4bf44e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.393893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bccb2-487a-4632-8caf-7d638e4bf44e None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.396047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 351/717] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:20.396873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bccb2-487a-4632-8caf-7d638e4bf44e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.405470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.407096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.407629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.408172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.409611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.410479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.412530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c8035-8ed4-4098-94d7-622434bd0ab6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.435092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 367/718] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.435914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1283e0-d230-4055-855a-d91553765676 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.436105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1283e0-d230-4055-855a-d91553765676 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.436362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1283e0-d230-4055-855a-d91553765676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.458508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fa1283e0-d230-4055-855a-d91553765676 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:20.459375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fa1283e0-d230-4055-855a-d91553765676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:20.528660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bccb2-487a-4632-8caf-7d638e4bf44e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.533260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 368/719] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:20.534154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1283e0-d230-4055-855a-d91553765676 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.582034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.582761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.583887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.584169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.584941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.585250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.586679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.594171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 352/720] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.595238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.650774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1283e0-d230-4055-855a-d91553765676 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.685036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.685786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.686011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.686309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.687136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.687439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.688879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:20.695095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 369/721] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:20.723422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d64b6-abef-464d-a8e8-2f8b1a3de2b5 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.769710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.770563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.770846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.771121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.783300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:20.794947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:20.796593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 353/722] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:20.802690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:20.945667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf74-074a-432d-935a-5a6291381cd8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:20.988677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:20.989671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:20.989945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:20.990212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:20.990984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:20.991280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:20.992639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.001291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 370/723] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:21.006521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.138023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db48ddc-4818-4f13-8184-e9ae6328a8dc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.187127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.187932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.188208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.188475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.199483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.200854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.226044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6c3955e4-647a-432e-a409-a7e371fa77bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:21.227300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 354/724] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:21.232785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.269497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f645-3f55-42df-990a-703ff9816c04 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.269814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f645-3f55-42df-990a-703ff9816c04 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.270037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6f645-3f55-42df-990a-703ff9816c04 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.272087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 355/725] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:21.276888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.277171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.277447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.296944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:21.298107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:21.344326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4201-cd2c-46b4-9b49-9eef1afcf3c0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.367551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 356/726] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:21.383930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.384591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.384865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.385130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.385839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:21.386134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.387751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.390359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.400415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 371/727] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:21.405862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.483270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de944d3-7e30-46a0-a9d1-6c4fa6e41884 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.516497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.517301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.517636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.517909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.520904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec241-70f5-4f14-81c8-9f3243bace3f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.528172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:21.535206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:21.536751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 357/728] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:21.542353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.568151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.570206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.570524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.570800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.585901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.589331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.615346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:21.620836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 372/729] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:21.626216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.699176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aea9e-ea27-4f8d-b992-0c64327ba925 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.771976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.772720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.772889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.773071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.774320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:21.775738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.777117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.795757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 358/730] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:21.798708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.808354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb731-d816-4d6a-af59-9a78111024cd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.852151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.852832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.853104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.853368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.854203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:21.854532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.856077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:21.886363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 373/731] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:21.891409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:21.909348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef693c8-2d4d-433a-8a5a-d288447237a2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:21.972101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:21.972900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:21.973173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:21.973439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:21.996751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:21.998203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.024491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:22.025630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 359/732] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:22.035138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f1e7-de62-490d-9759-d3bf2ff1e333 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.037789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.089228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.089886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.090162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.090458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.210287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.210287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.229003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823847e-3cc7-4436-9c4d-7808ade5f6ef None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.317300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 374/733] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 20 16:05:22.323821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.324335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.325017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.325295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.325566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.326332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:22.326643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.328044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.345958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 360/734] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:22.350415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.477410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92852302-4b02-4306-99c5-ac4da334ef46 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.515095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.515890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.516163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.516430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.532789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.534332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.553310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a54ac0-4701-41f7-9f14-95affa4574bb None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.564537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:22.565790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 375/735] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:22.573778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.619952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.620814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.621095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.621370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.637219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.638703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.661106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:22.662647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 361/736] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:22.667873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.679363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c380ad-ca66-46f8-aaba-1a93e7aaa2c1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.712417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.713081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.713355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.713619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.714362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:22.715991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.718561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.743007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 376/737] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:22.748503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.847869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7b00d-a660-4467-af4b-e49a16bb9391 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.913497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.914171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.914472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.914743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.915588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:22.916748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.917315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600ec19-95d5-4cbd-ad30-99f82b0863cf None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:22.930231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b564dd-50b3-41e3-9eb9-8e9627a234a9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:22.938481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 362/738] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:22.939878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff752-3b73-4110-8661-b84232f09b1f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.940162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff752-3b73-4110-8661-b84232f09b1f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.940435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adff752-3b73-4110-8661-b84232f09b1f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.942360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 363/739] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:22.943618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adff752-3b73-4110-8661-b84232f09b1f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:22.977847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:22.978696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:22.978976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:22.979244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:22.987753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:22.990541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.006089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-273a6d5f-55d6-4140-a713-52f0c604ba32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:23.008116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 377/740] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:23.009427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.009709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.009982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.030959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:23.032142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:23.063964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adff752-3b73-4110-8661-b84232f09b1f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.104547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.105558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.106035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.106617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.110340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 378/741] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:23.111549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.200129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.202903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.249462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c44851-43e1-45c1-bc0e-7622905a1738 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.290799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.291568 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.291851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.292125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.293142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:23.293664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.295475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.308169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 379/742] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:23.309011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.317349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 364/743] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 20 16:05:23.318638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.403548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eaf4-b4f9-459c-bfc6-de75bc745b55 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.421186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676589f-d212-42f9-858f-7b7569469ed1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.434490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.435152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.435438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.435710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.436421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.437787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.453617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 380/744] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:23 2022] POST /identity/v3/services => generated 251 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:23.454448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.472384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.473451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.473985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.474460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.475502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c40f1d846a554956a0d471e5718b8244) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:23.476071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.477751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ef7db-4da8-4b13-83b8-2a776e4df7d7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.494786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 365/745] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/role_assignments?user.id=c40f1d846a554956a0d471e5718b8244&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:23.496634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee185-7063-4778-bf94-6d2919f51ef5 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.497104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee185-7063-4778-bf94-6d2919f51ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.497576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee185-7063-4778-bf94-6d2919f51ef5 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.500020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 366/746] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:23.505987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af20f5-4c59-4b87-b5d4-aa3610ac77ae None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.506618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af20f5-4c59-4b87-b5d4-aa3610ac77ae None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.507064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af20f5-4c59-4b87-b5d4-aa3610ac77ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.539542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-70af20f5-4c59-4b87-b5d4-aa3610ac77ae None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:23.541132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-70af20f5-4c59-4b87-b5d4-aa3610ac77ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:23.583691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81710c-3b99-4f89-b892-7a5d382f26bf None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.628042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 367/747] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 20 16:05:23.643089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea15e-2ecb-428f-8317-10971f8df0a5 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.643712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea15e-2ecb-428f-8317-10971f8df0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.644165 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea15e-2ecb-428f-8317-10971f8df0a5 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.646687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 368/748] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:23.654393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.654578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.654864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.657777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.658660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.658938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.659203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.672364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.673988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.675563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:23.676902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:23.693539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:23.694536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 381/749] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:23.698382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.762295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 369/750] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 20 16:05:23.762295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.828431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298c63-d308-4352-a3c5-0a4e53c973b3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.868601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b16b7-dd2a-472f-819d-ffa0c42be4a0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:23.870368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.872161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.872675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.873155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.886134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:23.895426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:23.897507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 382/751] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:23.898933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:23.902751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:23.903952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:23.903952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:23.904237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:23.905116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:23.905465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:23.906978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:23.923193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 370/752] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:23.924280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.017532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e515479-06ce-410c-b3e9-00c6315c2cbe None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.025836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af41fc-89e9-488a-91ee-d4d8b30753e8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.056715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.057586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.058001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.058311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.058593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.059163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.059566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.059742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.060023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.060913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:24.061314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.061685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.062879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.072399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 371/753] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:24.073475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.086291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 383/754] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:23 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:24.089472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.249150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dab5b-d850-431c-9e19-df35424137ed None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.303148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e392c6-ec40-47ec-b83c-77d05d8af5c1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.331134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.332310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.332781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.333239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.337339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.338189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.338500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.338774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.345704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.347184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.348946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.350671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.362430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:24.367096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 372/755] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:24.370074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.371900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:24.373608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 384/756] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:24.383807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.493697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901376-2ce6-49a2-b45c-4edfc65d3215 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.535610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa83e-8912-4fb7-9a1b-f5cad6e4788d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.557684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.558726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.559197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.559692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.560599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:24.561101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.562809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.576059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 385/757] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:24.582051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.607730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.608402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.610434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.610716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.611588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:24.611896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.613339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.644503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 373/758] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:24.650304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.708693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa289-1197-4f91-9ccf-15a993a202b9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.756807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.757540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.757818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.758088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.765605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.767092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.780989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:24.782539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 386/759] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:24.788219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:24.870022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462594b-27d2-4111-99c1-50b2906a5a68 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.910642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.911408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.911762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.912107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.913011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c8dbf02e3130431c9bc3a95a97e039c7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:24.913428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.914995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:24.926431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 374/760] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/role_assignments?user.id=c8dbf02e3130431c9bc3a95a97e039c7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:24.942316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf8e7d-faac-48a4-9368-aa108fa7c526 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:24.986000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:24.987154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:24.987828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:24.988452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:24.990422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:24.991151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:24.993711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.018540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 387/761] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:25.023540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:25.126840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463f6a-f1c4-4506-8e41-bdaaed8fa875 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:25.162527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:25.163338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:25.163625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:25.163896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:25.175104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:25.176555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.194312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:25.195970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 375/762] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:25.202461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:25.316864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce2729-ad0b-4e07-8bf6-e7254a2fc904 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:25.363098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:25.363816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:25.364413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:25.364687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:25.365418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:25.365727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:25.367140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.378933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 388/763] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:25.387048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:25.489958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d447-877e-48de-a1f9-450659954494 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:25.525734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:25.526576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:25.526859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:25.527135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:25.534482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:25.535927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.549708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:25.551297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 376/764] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:25.559346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:25.684137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0ce4-866c-4542-ba33-64ebdcf927b8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:25.730155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:25.730876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:25.731158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:25.731432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:25.732247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:25.732555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:25.734061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91ac1-3aa5-433d-8168-2b9f7cac28eb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.752876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 389/765] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:25.758769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:25.864963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9419a9-42b6-49c5-947e-39f9cca7a135 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:25.905428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:25.906401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:25.906685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:25.906959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:25.908970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=8c61a24263474ff7926d416bedf11db7, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:25.910455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6419b-390c-4533-b8ac-c54834d24fec None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:25.930243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 377/766] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:25 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:26.120221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029006-4be9-4d65-9dd2-77bb7fd2a453 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.120503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029006-4be9-4d65-9dd2-77bb7fd2a453 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.121025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029006-4be9-4d65-9dd2-77bb7fd2a453 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.123399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 390/767] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:26.129260 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bc63-bf65-45aa-9c36-0d731dab8f99 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.129851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bc63-bf65-45aa-9c36-0d731dab8f99 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.130356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bc63-bf65-45aa-9c36-0d731dab8f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.149422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4504bc63-bf65-45aa-9c36-0d731dab8f99 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:26.150953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4504bc63-bf65-45aa-9c36-0d731dab8f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:26.221272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 378/768] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:26.233433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726af49-b53a-4640-8da0-619f324932f3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.233714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726af49-b53a-4640-8da0-619f324932f3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.234173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726af49-b53a-4640-8da0-619f324932f3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.236545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 391/769] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:26.241870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.242155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.242517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.247611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726af49-b53a-4640-8da0-619f324932f3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.263761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:26.264934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:26.369458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726af49-b53a-4640-8da0-619f324932f3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:26.406130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 379/770] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:26.406695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:26.407575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.407854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.408190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.408847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:26.410233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:26.427275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.428756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 20 16:05:26.430686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 392/771] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:26.438713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.606601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa085da0-5dbc-4505-a9e1-57ba7daa656e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:26.624207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dbc9-494d-48d8-8e25-15835ad6998a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:26.652448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:26.653376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.653805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.654217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.655123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:26.655624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:26.658183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:26.670089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 393/772] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:26.677904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.695461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:26.696282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.696594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.696838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.727159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:26.734344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:26.742735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 380/773] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:26.750162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.785302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e3a-b8df-4eb0-bb45-57d329d3bfc6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:26.820575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:26.821236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.821514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.821782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.830562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:26.830950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:26.832334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:26.841167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 394/774] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:26.851931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:26.900788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686917-462d-4ffa-8278-9a85a5e0ac53 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:26.959594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:26.961074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:26.961576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:26.962710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:26.964270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:26.964943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:26.967788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:26.984890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 381/775] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:26.985989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.012429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e01c7-cbb7-43ec-9c46-3b66ece1e3b1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.049354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.050479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.050961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.051429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.052426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] RBAC: Adding query filter params (interface=public, service_id=aef73c6654ad49489dc040e6656198ed, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:27.052940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.054528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd163b-1547-4d42-8e62-46ff862426e1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.062531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 395/776] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/endpoints?service_id=aef73c6654ad49489dc040e6656198ed&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:27.064096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f72c1-9720-419f-b691-9ceac45af461 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.064639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f72c1-9720-419f-b691-9ceac45af461 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.065111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f72c1-9720-419f-b691-9ceac45af461 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.067353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 396/777] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:27.069358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f72c1-9720-419f-b691-9ceac45af461 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.115830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daebc-713e-41de-ba4c-89d56c840afd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.156082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.157246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.157676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.158147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.171651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.173587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.180042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f72c1-9720-419f-b691-9ceac45af461 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.194244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-bafd16a8-5eb3-40a1-9294-cee4540483a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:27.196575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 382/778] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:27.198311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.198605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.198883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.224747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:27.225857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:27.229950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.230904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.231429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.232090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.232980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.235047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.247896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 397/779] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:27.247896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.361028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 383/780] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:27.378855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64e72-dccc-42c3-b0ae-c8b563e576c5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.413352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.415642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.416323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.416598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.416864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.417592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:27.417896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.419332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.443809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 398/781] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:27.449311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.519777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55d52-f192-401d-a6b6-2d11328fb261 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.558120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.558964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.559243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.559513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] PATH_INFO: `/v3/services/network` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.560167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.561552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.571425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be72c8-bebd-490a-ac18-2468838bf2dd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.572630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 20 16:05:27.574298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 384/782] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:27.579366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.612859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.613744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.614361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.614651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.623317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.624875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.639248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:27.640762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 399/783] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:27.647177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.702298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2805-a055-4743-b395-d1ec933cc3f1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.748619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70811-caa8-490f-a29e-a75901dda0a0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.778096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.778804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.779100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.779360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.780196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:27.780501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.781924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.782631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.783576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.784097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.784561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.785466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] RBAC: Adding query filter params (name=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:27.785961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.787592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.793050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 385/784] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:27.799205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.812609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 400/785] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:27.824840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.906128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cc28-045a-4479-b72f-e62e23a5e986 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:27.938124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:27.938894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.939282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.939617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.940378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] RBAC: Adding query filter params (type=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:27.940689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:27.942051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dba80-ff55-4cf7-87fe-07a081b9ddcb None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:27.947182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 386/786] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:27.948391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb47d-7bb4-47dc-b667-fcd6ec626cec None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:27.948670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb47d-7bb4-47dc-b667-fcd6ec626cec None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:27.949050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb47d-7bb4-47dc-b667-fcd6ec626cec None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:27.959711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 387/787] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:27.959711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb47d-7bb4-47dc-b667-fcd6ec626cec None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:27.973234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1301c0-798f-4dba-a15f-4a4b536a7b02 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.015949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.017481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.018170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.018609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.032083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.033746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.052439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-1d7c5e85-61c1-4189-8fec-6f031f7e55e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:28.054184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 401/788] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:28.055721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.056223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.056695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.065476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb47d-7bb4-47dc-b667-fcd6ec626cec None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.074200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:28.075637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:28.098605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.099304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.099581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.099849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.100681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] RBAC: Adding query filter params (interface=public, service_id=c4221168ee684cb5a8feae068baee19a, region_id=RegionOne) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:28.100985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.102367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.114615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 388/789] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:27 2022] GET /identity/v3/endpoints?service_id=c4221168ee684cb5a8feae068baee19a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:28.115472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.150354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 402/790] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:28.151561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.218872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88c6f-656b-4470-837a-8f786362298a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.253058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.254039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.254530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.254993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.255890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:28.256375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.257911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.270408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 389/791] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:28.275715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.275833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae719f9-6d89-4f2e-9b42-9dfe99190443 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.312340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.313041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.313389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.313730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.314637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.316196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.330286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 403/792] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:28.330286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.417307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553fd0-1414-4c68-8001-0d4e432fbb6b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.427934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a8a7-c10f-479e-b743-b0e7d24203a6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.462013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.462861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.463142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.463416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.471166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.472650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.487316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:28.488628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 404/793] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:28.494945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.515987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.516806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.517084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.517395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.551365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:28.558620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:28.566533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 390/794] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:28.584193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.603462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51ccf-5201-4c20-872c-e7216722e78f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.636566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.637225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.637504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.637778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.638585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:28.638897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.640337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.658316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 405/795] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:28.659683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.700011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bb49c-3be9-4019-bef3-8355ad9d1305 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.741560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.742291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.742733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.743014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.744138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:28.744694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.746335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529b952-7404-401d-868c-bf39bfe55d6a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.757403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 391/796] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:28.758822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809836d7-9733-4538-8382-adc716650806 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.759107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809836d7-9733-4538-8382-adc716650806 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.759376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809836d7-9733-4538-8382-adc716650806 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.761023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 392/797] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:28.763872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809836d7-9733-4538-8382-adc716650806 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:28.770300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507eec-9753-4a63-a344-6383a8a6e54b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.810898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.812399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.812682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.812957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c40f1d846a554956a0d471e5718b8244/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.830803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=c40f1d846a554956a0d471e5718b8244, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.832221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2e9-7a5e-451d-9ccc-bb1799721661 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:28.850345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 406/798] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:28 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c40f1d846a554956a0d471e5718b8244/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:28.851650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.851935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.852297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.885912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:28.888681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:28.894726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809836d7-9733-4538-8382-adc716650806 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:28.958022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:28.958878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:28.959154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:28.960258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:28.979987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:28.981702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.001445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:29.003170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 393/799] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:29.012121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.022641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 407/800] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:29.058762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.146096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a083-7eb8-4613-9044-dd5d78aed8ee None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.185032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac7b0-6820-4fed-8f6a-cd67f4d5ec66 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.191045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.191841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.192127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.192402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.193142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:29.193450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.194972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.220074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 394/801] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:29.222602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.240211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.241390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.241862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.242306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.263395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:29.270763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:29.272377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 408/802] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:29.281586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.338213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf49bc-5e68-447a-a708-a034ff326f5f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.377978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d002d-4a85-4705-9461-c834a763490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.378806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d002d-4a85-4705-9461-c834a763490c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.379080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d002d-4a85-4705-9461-c834a763490c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.379347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d002d-4a85-4705-9461-c834a763490c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.389884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d002d-4a85-4705-9461-c834a763490c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.391572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d002d-4a85-4705-9461-c834a763490c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.412265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-722d002d-4a85-4705-9461-c834a763490c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:29.413697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 395/803] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:29.420708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d002d-4a85-4705-9461-c834a763490c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.460295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7374ba-7549-473f-9193-ad14444a440c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.519481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.520173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.520446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.520714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.521463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:29.521759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.523190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.537177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 409/804] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:29.544127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.592012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d002d-4a85-4705-9461-c834a763490c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.650902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.651933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.652430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.652885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.653898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:29.654416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.657161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.685955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 396/805] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:29.694909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.714452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545da8-74fa-499a-a784-4f0f6354c85f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.779350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.780543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.781026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.781480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.799068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.801482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.827304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:29.834497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 410/806] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:29.842016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.848644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f3b5-5a92-4c80-b461-b1b588a105f5 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:29.901645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:29.902729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.903179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.903593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.914124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:29.915632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:29.932402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-b987ba48-45e7-47da-b24a-e794b831e778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:29.933810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 397/807] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:29.935057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3cf-c436-4219-acd3-65dd920451ae None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:29.935571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3cf-c436-4219-acd3-65dd920451ae None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:29.936109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3cf-c436-4219-acd3-65dd920451ae None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:29.942372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 398/808] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:29.943463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a3cf-c436-4219-acd3-65dd920451ae None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:29.975186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f037cde-41e5-4567-9b39-76a63e74498e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.015260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.015940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.016215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.016480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.017198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.017538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.018994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64eeb7-9b27-4fd5-97c0-cc23d738f801 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.033519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 411/809] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.035130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.035416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.035687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.047131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a3cf-c436-4219-acd3-65dd920451ae None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.054029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:30.055348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:30.084919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.085969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.086495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.086967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.087954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.088454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.090068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.102521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 399/810] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.103700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.130278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 412/811] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:30.130278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.230872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c7da-96ae-4f3b-b630-e2ac22048642 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.235001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ab1b-c49a-4616-8835-7e729a6bf09f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.267589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.268787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.269272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.269737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.269903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.270930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.271353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.271789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.278579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.278904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.280368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.280693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.293435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:30.294823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:30.295009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 413/812] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:30.296000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.296727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 400/813] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:30.303251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.401619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbc5b-ca9c-4c7b-a7aa-6f5bab1f21a1 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.411860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726b2f-5914-46f5-b22c-6215dd03450b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.441155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.442558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.443136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.443688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.444583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.446181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.451838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.452496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.452780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.453054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.453841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.454148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.455682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.459863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 20 16:05:30.461247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 414/814] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:30.462237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.468273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 401/815] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.469165 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.561075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d140-3d85-42fc-bb34-fe19659420c5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.568163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc584cc-0964-41d7-816a-f3f23652cb4d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.595113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.596237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.596733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.597232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.598300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.598931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.600556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.603779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.604197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.604478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.604758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.605463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.605767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.607177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.612212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 402/816] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.612890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.621299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 415/817] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.622448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.710690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ef36-80e7-4033-ac2f-53b312ad14ef None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.720270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc53ff-dc60-4e83-b4df-9e9441eb1890 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.747005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.747933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.748192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.748464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c8dbf02e3130431c9bc3a95a97e039c7/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.750535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=c8dbf02e3130431c9bc3a95a97e039c7, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.752070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.760439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.761444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.761924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.762483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.763480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:30.764009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.765673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:30.767480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 403/818] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:30 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c8dbf02e3130431c9bc3a95a97e039c7/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:05:30.768520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.771981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 416/819] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:30.782472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:30.873089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462d5-6e9b-4b72-afc3-096d9fe87b52 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:30.908698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:30.909349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:30.909629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:30.909907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:30.982466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:30.983971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.035602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc76e-ddd3-4856-b36d-7c44f4ccc35c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.082475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.083158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.083435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.083715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.084456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.085868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0165b97-4280-4768-85a6-68cc351f8999 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.088816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 404/820] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:05:31.094394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.116769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 417/821] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:31.184880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16b453-8917-4b51-b15e-31683c8750d0 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.185540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16b453-8917-4b51-b15e-31683c8750d0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.185995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16b453-8917-4b51-b15e-31683c8750d0 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.188398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 418/822] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:31.194863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.195456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.195890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.210301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca1b51-c3a5-4790-b9cf-4a5190245778 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.214797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:31.216161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:31.257646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.258387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.258666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.258938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.269444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.270961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.287403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 419/823] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:31.294276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:31.294276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 405/824] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:31.296621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.312673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.418644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75fd7-ed0f-45d4-9bb1-9f64764ca593 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.419174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beba86-b0d0-4e01-afdc-1c64a06a689d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.455863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.456900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.457403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.457890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.458864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:31.459367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.460618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.461241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.461415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.461701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.461976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] PATH_INFO: `/v3/services/network` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.463877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.464671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.476060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 420/825] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:31.477923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 20 16:05:31.482036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 406/826] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:31.482193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.485227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.587784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f684c-de5c-4cc8-bca2-cc08ca0f46f4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.594857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86935c-ec1a-44ba-8fc6-44374d05b981 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.620009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.620812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.621087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.621556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.628044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.629419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.629563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.630453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.630933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.631402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.632311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] RBAC: Adding query filter params (name=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:31.632811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.634395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.644025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b9dfe625-1db7-436d-bd1f-f05d9996ece9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:31.644181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 421/828] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:31.644563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 407/828] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:31.645333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bb46-481c-4059-863e-76380dd5d9e2 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.645609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bb46-481c-4059-863e-76380dd5d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.645875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bb46-481c-4059-863e-76380dd5d9e2 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.646185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.652185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 422/829] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:31.652916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bb46-481c-4059-863e-76380dd5d9e2 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.747409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c726d0-72f3-4717-89b7-1dd626f10e48 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.752340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bb46-481c-4059-863e-76380dd5d9e2 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.782302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.783353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.783834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.784334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.785238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] RBAC: Adding query filter params (type=network) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:31.785754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.788372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d952f6-d0c8-4b3c-b652-b239bd48983f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.798302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.798302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.798650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.798877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.799342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 408/830] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:31.799821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:31.800125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.801399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.801573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.802038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.802568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.814088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 423/831] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:31.814932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.821135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:31.822546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:31.898736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 409/832] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:31.900031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:31.936197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9c0d-ca70-466e-a6aa-15b87d2bf566 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:31.968945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:31.969608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:31.969881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:31.970283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:31.971009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:31.972378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:31.998285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 424/833] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:31.998285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:32.045088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8cc0a-4c09-4402-9493-d1d75566aa90 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.113002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68bc31-c679-4b55-a0e2-1ea0d784d999 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.136511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.137881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.138382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.138875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.139906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:32.140419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:32.142088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:32.150664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.151402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.151681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.151950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.152244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 410/834] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:32.176741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:32.188653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:05:32.191122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 425/835] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:32.199758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:32.364394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e138c-e512-43f0-82f2-e9b017f7840d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.407824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.408486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.408767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.409045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.409799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:32.410104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:32.411509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:32.420079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 411/836] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:32.425552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:32.534720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6ffdd-2c51-4aa4-9d1c-e0afd27c7378 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.568419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.569228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.569502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.569773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.581640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:32.583151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:32.599563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:32.601049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 426/837] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:32.606395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:32.707118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08d0c3-e75e-4df2-9a24-cf3e21a81ad9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.739618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.740281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.740562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.740834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.741552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:32.741855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:32.743255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:32.755091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 412/838] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:32.763541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:32.860192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea3b7-512a-4bfe-9a1d-2ca4166df2d6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:32.892891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:32.894073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:32.894600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:32.895072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:32.902786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:32.904522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:32.918907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:32.920597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 427/839] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:32.926405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.027699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074baf61-32ce-40d2-8592-c5eaacaef809 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.065217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.065896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.066174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.066532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.067379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:33.067733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.069297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94e698-e840-411c-b25d-52730b67f9f4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.087416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 413/840] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:33.092988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.190829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86749300-7396-40b9-a2eb-8fe8216a9401 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.229595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.230618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.231097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.231586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.298006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.299892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859919d-c204-482a-9797-ae96dab17f8f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.396628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1cb5-0c7f-4b02-b457-5712300535b7 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.397166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1cb5-0c7f-4b02-b457-5712300535b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.397166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1cb5-0c7f-4b02-b457-5712300535b7 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.400429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 414/841] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:33.400578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 428/842] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:05:33.406457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1cb5-0c7f-4b02-b457-5712300535b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.407884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.408186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.408464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.429021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:33.430219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:33.505523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 429/843] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:33.523360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1cb5-0c7f-4b02-b457-5712300535b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.529693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.557306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.558035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.558354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.558631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.568684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.570142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.587289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:33.588801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 415/844] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:33.594130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.628533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05044d86-bab3-4376-b102-c9f9bc6643a8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.662552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.663691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.664167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.664633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.675168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:33.682370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:05:33.688663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 430/845] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:33.689775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.692711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f8c45-c8e4-49a0-ba6f-511bfc5d18ef None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.727713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.728380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.728662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.728938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.729809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:33.730017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.731369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04631e3-cbce-4fdb-8910-bfe87df3f8f4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.747216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 416/846] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:33.748592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8df22-049f-421b-9ca6-cb5ab2cb385f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.748961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8df22-049f-421b-9ca6-cb5ab2cb385f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.749146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8df22-049f-421b-9ca6-cb5ab2cb385f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.750938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 417/847] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:33.754289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8df22-049f-421b-9ca6-cb5ab2cb385f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.791178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ccfa-b6e4-48c0-8d06-739b40a20ce9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.822517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.823117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.823395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.823661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.824396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:33.824697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.826057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5f4d5-b6e6-4a04-b5c0-e37e8f2553c7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.838448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 431/848] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:33.838448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.838448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.838448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.851181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:33.852337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:33.854875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8df22-049f-421b-9ca6-cb5ab2cb385f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:33.887276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:33.888080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:33.888363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:33.888636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:33.895110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:33.896553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:33.910271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:33.911636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 418/849] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:33.912275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:33.922313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 432/850] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:33.922313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.016053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0359b1-98b7-4fbc-956e-0bfa31243432 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.021466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e862e-0c3e-4713-ba49-e23dc0b79555 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.047847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.048693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.048978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.049254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.054786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.055458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.055740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.056008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.056778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.057081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.058555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.059696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.061133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.074577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 433/851] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.074577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.082740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:34.088340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 419/852] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:34.088340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.171104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845423-cd84-45a7-a1e3-7c0183e85c3f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.180817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca948d5-59a0-4bc2-b9ee-711138bafe37 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.205272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.206090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.206412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.207023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.207400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.208814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.221535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.221535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.221535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.221535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.221894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 20 16:05:34.221964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c40f1d846a554956a0d471e5718b8244) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.221964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.222093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 434/853] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:34.222936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.227752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.233942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 420/854] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/role_assignments?user.id=c40f1d846a554956a0d471e5718b8244&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.234780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.341396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da902f-693f-47dd-8b2e-b36bf3f9c514 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.359946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7720e-16ac-48d8-8700-80ccfdf20d71 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.378678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.379360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.379639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.379912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.380637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.380941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.382423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.392431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 421/855] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.393483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.404659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.405693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.406233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.406749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.407703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.408274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.409897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.423045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 435/856] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.428316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.500011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207b2b-8c94-4f37-83a8-972f259578a2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.540147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.540817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.541097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.541371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.542078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.542413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.543812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.548847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 422/857] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.555422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71c0bc-2b43-403c-b73b-b54f62ee9a7d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.596882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.597626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.597902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.598173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.606377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.607861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.623728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a731da0b-7f10-4773-8d50-b2c9f554c1d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 20 16:05:34.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 436/858] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:34.630856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.702123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790db37-0413-4bbb-aa06-4302c7d52b23 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.702493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790db37-0413-4bbb-aa06-4302c7d52b23 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.702682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790db37-0413-4bbb-aa06-4302c7d52b23 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.705628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 437/859] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:34.710871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.711157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.711437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.731557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:34.733769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:34.746565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a8fe-fe49-4b7e-b801-68a760beaa9e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.784099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.785158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.785657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.786211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.787343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:34.787857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.789544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.807684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 423/860] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:34.815419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.817292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 438/861] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:34.839505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:34.913188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ef8b-5e0c-4713-8d6c-2ea7d3327e81 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.937083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba9ae1-ed36-4825-a3a9-be6268b62b64 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:34.947080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.947787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.948105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.948391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.972559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:34.973712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:34.974231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:34.974754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:34.975601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:34.977167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:34.988845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 20 16:05:34.995541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 439/862] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:34.996570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.016735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.018234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.093251 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f800f-535e-4931-9d37-b8242b618ee2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.118599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 424/863] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:05:35.119665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.127463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.128387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.128864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.129334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.130296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:35.130798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.132370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.137460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 440/864] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:35.143316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.238303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3910c-eefe-4368-9e14-5d6d1089b060 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.240396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a290-2af0-45eb-ac42-5587e0c7dd00 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.267380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.274890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.274890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.274890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.282279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.283951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.284541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.284897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.285277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.286232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:35.286371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.287050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.289205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.295042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 441/865] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:35.306312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:35.310502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 425/866] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:35.311680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.416008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695066ae-f91d-4a71-9704-27569f9cb22c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.456064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.456753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.457094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.457311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.458058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:35.458394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.459812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.473178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 442/867] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:35.478241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.578861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b88-0ce5-459e-bed6-683a535f7fe3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.612689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.613846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.614684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.615168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.622111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.623928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.637601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:35.639499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 426/868] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:35.646300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.740810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc80e53-f124-46f6-ab4b-43a6fda5f46c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.779608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.780758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.781257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.781746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.783339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:35.783905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.786006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de550-21aa-427e-814d-1ce67f0c804a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.798096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 443/869] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:35.803816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:35.901611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad7399-796b-4b8b-a9ad-2ebc88974b47 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:35.934317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:35.934973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:35.935250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:35.935525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:35.936345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c8dbf02e3130431c9bc3a95a97e039c7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:35.936652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:35.938075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf1d8b-ef8f-4f28-bc92-8d70d4d41637 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:35.944303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 427/870] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:35 2022] GET /identity/v3/role_assignments?user.id=c8dbf02e3130431c9bc3a95a97e039c7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:36.701938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c93e7-bfc1-46ac-8a4e-056a862fce1b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:36.702513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c93e7-bfc1-46ac-8a4e-056a862fce1b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:36.702513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c93e7-bfc1-46ac-8a4e-056a862fce1b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:36.704484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 444/871] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:36.709915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f1cd-0ee4-4249-a338-d4d3c4d251cd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:36.710380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f1cd-0ee4-4249-a338-d4d3c4d251cd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:36.710572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467f1cd-0ee4-4249-a338-d4d3c4d251cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:36.731524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1467f1cd-0ee4-4249-a338-d4d3c4d251cd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:36.732708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1467f1cd-0ee4-4249-a338-d4d3c4d251cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:36.797338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 428/872] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:36.820926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c93e7-bfc1-46ac-8a4e-056a862fce1b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:36.922040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c93e7-bfc1-46ac-8a4e-056a862fce1b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:36.956601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:36.957353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:36.957683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:36.957956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:36.963438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8339f7-3aa3-482a-b89a-7ab263545b7f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:36.964159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8339f7-3aa3-482a-b89a-7ab263545b7f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:36.964648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8339f7-3aa3-482a-b89a-7ab263545b7f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:36.966903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 429/873] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:36.970715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:36.972131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:36.972623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:36.973096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:36.976784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:05:36.982292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 445/874] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:05:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:36.983861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:36.998036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:36.999570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:37.084828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 430/875] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:37.101081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadda49-f1a8-46fe-b96a-b1b189a358b3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.103327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.143276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.143955 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.144592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.144592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.145239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:37.145542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.146967 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.159634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 446/876] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:05:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:37.160946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.204645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4911d3-c285-4365-a5ca-22bfbda643ab None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.238862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.240042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.240418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.240782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.241626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.243111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.257848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ce2d-62a8-4e66-98c3-0cd9a569c0be None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.266653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 431/877] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:37 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:37.301729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.302728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.303011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.303281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.316404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.317984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.336733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:37.342524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 447/878] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:37.344202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.454926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e920-9f12-4e17-8ae3-41e680902b8d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.487505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.488098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.488376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.488644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.489679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:37.490028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.491431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24945022-fd9d-467f-a3bf-c9d3bb0addec None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.503544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 432/879] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:37.509331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.607478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5e75-1f3b-4971-9114-0d237bd9acbf None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.643394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.644215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.644494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.644828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.652540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.654039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.667907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:37.668651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea4c4-c956-42c9-b121-5ce8a6d2112e None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.668939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea4c4-c956-42c9-b121-5ce8a6d2112e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.669217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea4c4-c956-42c9-b121-5ce8a6d2112e None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.669417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 448/880] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:37.671252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 433/881] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:37.679225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.679905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.680451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.680951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.698048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:37.699527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:37.777462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 434/882] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:37.800313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.806590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43773b-cf4f-41dc-8b20-060a38a9c385 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.840104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.841137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.841617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.842102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.843201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:37.843717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.845394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.863123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 449/883] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:37.868948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:37.904001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e3d5-9b0e-451f-a596-800b8d67ba43 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:37.941447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:37.942571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:37.943071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:37.943550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:37.944670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:37.946345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:37.964349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 435/884] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:37 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:37.976082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef541b7a-495c-413a-8402-c340c2efbca0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.021214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.022288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.022748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.023189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.094447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.096277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c13253-4b6e-494d-987f-c05d9fa31719 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.198422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 450/885] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:05:38.206853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.272229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9a21-90f1-44f7-b56f-36d017915c6c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.272557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9a21-90f1-44f7-b56f-36d017915c6c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.272783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9a21-90f1-44f7-b56f-36d017915c6c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.274972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 451/886] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:38.280089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.280374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.280649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.299484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:38.300670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:38.318922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a72-3b3b-413a-81a3-2ee9e8098178 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.352626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.353764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.354282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.354749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.366277 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.367671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 452/887] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:38.374293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.391484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:38.391668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.393634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 436/888] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:38.399398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.502468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541df-88e5-4153-afd9-ff05fefca5a9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.514848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe3df-4923-4f15-8d4b-947b2daa40a6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.537362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.538403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.538880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.539360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.540297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:38.540815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.542470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.553531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.554383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.554658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.554912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.555646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.560101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.560575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 437/889] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:38.561701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.569332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 20 16:05:38.574332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 453/890] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:38.576916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.664876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c16b-5e5a-4ffc-ab50-1ce047c2e8f3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.683157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76a983-41de-46b6-a1f2-281c9f1ae4cf None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.698142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.699030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.699319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.699593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.706447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.707920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.718118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.719049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.719537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.720015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.720947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:38.721051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:38.721551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.723115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.727012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 438/891] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:38.727850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.733549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 454/892] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:38.734700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.825634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dcde3-ef23-4a9f-9d4a-b9d216be2533 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.830374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bdce-6057-4a97-82ec-1b0cfea69072 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:38.859428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.860095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.860375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.860661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.861486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:38.861794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.863254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981a3a4-15c1-4140-a973-500c4eb9e4f8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.864597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:38.865344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:38.865691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:38.866029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:38.866832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:38.867195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:38.868602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:38.873513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 455/893] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:38.875516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 439/894] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:38.881729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:38.990609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e299f-7561-40f9-9c9f-dd366934bc46 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:39.025587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:39.026333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:39.026617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:39.026888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:39.027778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] RBAC: Adding query filter params (role.id=ba32378df9354a9f872e43f524405761, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c40f1d846a554956a0d471e5718b8244) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:39.028086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:39.029558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849374-8b06-40fc-9625-186d8a18b272 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:39.036067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 456/895] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:38 2022] GET /identity/v3/role_assignments?user.id=c40f1d846a554956a0d471e5718b8244&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=ba32378df9354a9f872e43f524405761 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:39.672131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5952-8f3f-4d64-8ca6-d47ef21865a7 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:39.672605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5952-8f3f-4d64-8ca6-d47ef21865a7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:39.672790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5952-8f3f-4d64-8ca6-d47ef21865a7 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:39.674839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 440/896] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:39.680148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:39.680435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:39.680711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:39.699796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:39.701303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:39.770356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 457/897] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:39.788815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5952-8f3f-4d64-8ca6-d47ef21865a7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:39.894799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5952-8f3f-4d64-8ca6-d47ef21865a7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:39.929151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:39.930310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:39.930808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:39.931287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:39.932208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:39.933853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:39.945393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 20 16:05:39.951755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 441/898] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:39.953361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.056843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d1f5-7cc4-471c-9c1e-f069f260336f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.092564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.093346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.093625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.093896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.094632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:40.094936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.096332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.101394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 458/899] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:40.107087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.210303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bf4a4-2139-4b13-a88e-67dd206e654c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.241437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.242109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.242433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.242710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.243423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:40.243730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.245107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ea2f-d060-4c93-8614-04a1d028859f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.254363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 442/900] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:40.256110 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.355283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875d1a-152a-4b1f-875f-005b9b4da590 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.357754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c6cb-f1c5-4cc7-b4fc-ed25aaefa36c None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.358039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c6cb-f1c5-4cc7-b4fc-ed25aaefa36c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.362292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c6cb-f1c5-4cc7-b4fc-ed25aaefa36c None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.362292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 443/901] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:40.365350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.365630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.365899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.382573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:40.383725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:40.392745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.393899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.394657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.395094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.396273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] RBAC: Adding query filter params (interface=public, service_id=f80b5f98d0ea4189827e251f7ab1e0a4, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:40.396743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.399010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.405544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 459/902] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/endpoints?service_id=f80b5f98d0ea4189827e251f7ab1e0a4&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:40.411016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.450053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 444/903] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:40.472142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.521917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ec20-9089-4574-bb25-4acfbc45cd42 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.553724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.554415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.554692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.554957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.555627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.556979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.562883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 460/904] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:05:40.591901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840c41-be31-49cb-8f47-7e17cb90b87e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.629526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.630403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.630681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.630955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.631608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.632998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.645235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 20 16:05:40.646853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 445/905] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:40.652960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.754801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e29e-0708-408a-b03f-ecc1b0e35f41 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.789742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.790454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.790734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.791004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.791720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:40.792023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.793544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.798641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 461/906] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:40.803959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:40.907985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16110-0601-463f-970f-50c4002516c1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:40.945830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:40.946526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:40.946808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:40.947082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:40.947796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:40.948094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:40.949466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:40.954983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 446/907] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:40.960525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:41.057036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7717331-5d18-407e-8b29-1dbcd1624a2a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:41.093034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:41.093712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.093988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.094269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.095082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] RBAC: Adding query filter params (interface=public, service_id=09461646abb343dca8680b80d983e021, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:41.095428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:41.096818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb913397-5e10-4a83-be12-7cc94c05f008 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:41.102957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 462/908] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:40 2022] GET /identity/v3/endpoints?service_id=09461646abb343dca8680b80d983e021&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:41.108546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:41.207309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4dc1-3dc6-476b-8b1e-868178470134 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:41.224200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6debd-63fb-457d-8857-0ece3e82d564 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.224200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6debd-63fb-457d-8857-0ece3e82d564 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.224200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6debd-63fb-457d-8857-0ece3e82d564 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.225155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 463/909] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:41.230642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91758-f3a4-44b1-bbfc-6b5202e7876f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.231224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91758-f3a4-44b1-bbfc-6b5202e7876f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.231694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91758-f3a4-44b1-bbfc-6b5202e7876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.249143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-58a91758-f3a4-44b1-bbfc-6b5202e7876f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:41.249984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:41.250600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-58a91758-f3a4-44b1-bbfc-6b5202e7876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:41.251040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.251450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.251920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.252965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:41.255270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:41.262583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 447/910] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:41 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:05:41.327543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 464/911] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:41.351016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:41.460384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1ada-fc1d-4547-8487-54d8cd7b0c18 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:41.462529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84cc9-3195-4a47-8612-148e9e8870ce None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.462816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84cc9-3195-4a47-8612-148e9e8870ce None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.463091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84cc9-3195-4a47-8612-148e9e8870ce None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.465184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 465/912] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:41.471753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.472131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.472404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.492508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:41.493731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:41.498367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:41.499041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.499322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.499598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.500321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:41.501755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:41.517613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 448/913] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:41 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:41.574959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 466/914] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:41.597412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:41.702959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaded2e-357a-4386-a356-bbf4cc603cef None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:41.740539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:41.741771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.742245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.742762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.755390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:41.763786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:05:41.764917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 449/915] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:05:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:41.770778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:41.867090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd376b5-e50d-4aca-bf5f-96c32f685a0f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:41.899800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:41.900473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:41.900750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:41.901018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:41.901757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:41.902053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:41.903452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:41.911533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 467/916] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:05:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:41.917086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.015567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6094-5ab9-4945-b2fa-87aec7daf641 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.048262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.049426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.049946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.050522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.061349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.063080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.079633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:42.081369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 450/917] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:42.087181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.183729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a05f-994a-4a3b-93a6-40fad58a956e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.216440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.217117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.217398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.217668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.218422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:42.218726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.220156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.232360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 468/918] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:42.237901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.336913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7bf41-3572-4dfa-916d-ad8cc54a5009 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.370550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.371764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.372255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.372721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.380730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.382424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.396394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:42.398189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 451/919] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:42.407392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.506650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284014d-eeb1-4bc5-812f-b68047278c08 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.540021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.541064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.541554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.542026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.543082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:42.543590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.545340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.565622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 469/920] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:42.571739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.670743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9884b5-adf4-4f80-80cb-ba30a95032d6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.703919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.705130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.705649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.706186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.716923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.718613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.735212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:42.736985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 452/921] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:42.743121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.843959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381645-c711-400f-9e04-d7a4292448d8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:42.877125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:42.877797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.878077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.878379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.879109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:42.879413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:42.880783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fe084-5256-4dca-861e-56dda8b72f2b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:42.892748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 470/922] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:42.898358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:42.917457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645840-2537-4ed3-bc55-44a781c0350b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.917748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645840-2537-4ed3-bc55-44a781c0350b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.918007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645840-2537-4ed3-bc55-44a781c0350b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.920703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 471/923] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:42.925968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:42.926247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:42.926544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:42.945491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:42.946969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:43.016844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1dc1-ab1f-4756-a3c3-9194bc54400d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.034299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 472/924] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:43.052471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.059824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.060628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.060904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.061173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.070155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.072081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.090374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:43.091870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 453/925] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:43.098073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.156017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a2764-06f8-467b-909b-fc1dae6bb819 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.189665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.190923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.191432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.191909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.192808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.194427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.194877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c96e-41fe-4eb9-b6a6-5e816cc1613e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.212241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 20 16:05:43.221533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 473/926] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:43.222740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.231949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.232608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.232888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.233157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.233945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:43.234679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.235780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.248333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 454/927] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:43.255033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.329240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd226-2b1d-46ea-b9a6-c76c634f7770 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.356767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb0a-641a-44ff-a041-e206d7690d01 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.362977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.363914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.364699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.365183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.366083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:43.366610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.368179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.377970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 474/928] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:43.379257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.390339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.391381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.391492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.391768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c40f1d846a554956a0d471e5718b8244/roles/ba32378df9354a9f872e43f524405761` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.394222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=c40f1d846a554956a0d471e5718b8244, role_id=ba32378df9354a9f872e43f524405761)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.395702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.411679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 455/929] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:05:43 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/c40f1d846a554956a0d471e5718b8244/roles/ba32378df9354a9f872e43f524405761 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:05:43.487113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91da752-30ce-497d-9ce9-d6d6bdcb94f8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.524092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.525164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.525672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.526150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.527084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:43.527595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.529218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fc7c5-c972-44ab-b392-e4b146028938 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.535492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 475/930] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:43.541426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.646207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df60a-5abb-4451-8719-8ce3e2f36a90 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.669684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeacdf-2206-4858-8164-f566e65ceaaf None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.670225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeacdf-2206-4858-8164-f566e65ceaaf None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.670653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeacdf-2206-4858-8164-f566e65ceaaf None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.672861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 476/931] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:43.677734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.678136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.678555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.694538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.695595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.696219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.696374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:43.696977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.697705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:43.698549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.700262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.728386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 456/932] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:43.781747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 477/933] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:43.805791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:43.912259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777cda-3689-4000-8982-e9bc05e406fc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:43.945818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:43.947000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:43.947496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:43.947958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:43.948817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:43.950523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:43.962371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-d9c3734f-222f-4616-9ba4-91e3f838d90b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 20 16:05:43.964084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 457/934] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:43.971479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.012302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8572fb-3817-4834-b800-5c1cecd7a350 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.012588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8572fb-3817-4834-b800-5c1cecd7a350 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.012871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8572fb-3817-4834-b800-5c1cecd7a350 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.014991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 458/935] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:44.019909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.020496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.020496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.037269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:44.038522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:44.084248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5a6b-4044-425d-8817-88b43edf2fdc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.110393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 459/936] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:44.121503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.122397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.122839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.123249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.124091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:44.124530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.126030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.128225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.132722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 478/937] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:44.138395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.231839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaee0b-d31c-4bfa-ac00-ece124e4b953 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.268154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749ec4b-41d9-416e-a920-019313d922fe None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.275910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.276988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.277880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.278420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.279656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.281790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.296917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 20 16:05:44.299178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 460/938] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:44.304024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.304412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.305295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.305821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.306348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.307447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:44.308786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.310481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.317142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 479/939] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:44.322156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.403848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9ebcc-0683-4445-a884-b76df51306e9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.421384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7f7eb-98cf-420a-a125-ba703e493077 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.437086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.438090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.438585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.439135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.440051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:44.440547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.442118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.447463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 461/940] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:44.453108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.464389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.465720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.466205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.466973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.468197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.470412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.494676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 480/941] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:44.566301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d86b26-0e41-4a30-a05a-1c61307eefe8 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.611418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.612475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.612989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.613457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.614720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:44.615241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.616841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.623112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 462/942] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:44.631647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.731728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4377ab-3017-4990-86f6-e88e56e643db None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.763964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.764632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.764918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.765185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.766025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] RBAC: Adding query filter params (interface=public, service_id=3d188ae3a9dd4ad387b2c44333105669, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:44.766354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.767840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bee00-0f07-4c17-85f1-fc04cae7ed7f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.773311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 481/943] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/endpoints?service_id=3d188ae3a9dd4ad387b2c44333105669&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:44.778824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:44.875025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083269-2957-4bdb-a281-3ef0de359f4a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:44.908058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:44.908742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:44.909019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:44.909286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:44.909967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:44.911395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae011d-a2b3-43d3-b623-6b579023f020 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:44.918430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 463/944] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:44 2022] GET /identity/v3/services => generated 1497 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:05:45.773359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89018-458d-433e-8f67-85ce68a451d7 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:45.773898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89018-458d-433e-8f67-85ce68a451d7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:45.773898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89018-458d-433e-8f67-85ce68a451d7 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:45.776111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 482/945] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:45.781620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:45.782072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:45.782244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:45.799232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:45.800399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:45.870371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 464/946] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:45.887780 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a89018-458d-433e-8f67-85ce68a451d7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:45.993868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a89018-458d-433e-8f67-85ce68a451d7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.026900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.027643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.027922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.028191 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.039031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:46.046921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5512f56d-4ba9-4af9-9220-6a21630a1642 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:05:46.048577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 483/947] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:05:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:46.054462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.092362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b89d4-d602-4c13-97de-1da8e4ed099c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.092695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b89d4-d602-4c13-97de-1da8e4ed099c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.092918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b89d4-d602-4c13-97de-1da8e4ed099c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.094951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 484/948] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:46.099981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.100261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.100537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.117470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:46.118727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:46.165773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15887a-c766-48e5-9ff7-a43ab2b98665 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.192587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 485/949] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:46.208317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.209225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.209649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.210093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.211021 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:46.212096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.213791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.215594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.228917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 465/950] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:46.230367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.329924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258dc0-bf69-499e-8e36-c1b52fddc32f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.351264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad319f9-b32d-4cd7-975f-97809ab122e5 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.369990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.371035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.371400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.371768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.372875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.374477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.376050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.common [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 20 16:05:46.396104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.397463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.397578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.sql.core [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 20 16:05:46.397578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 20 16:05:46.397578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [parameters: {'id': '59f28203e3264ac09ee5b76be141e41b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 20 16:05:46.397578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79876) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 20 16:05:46.398205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.398683 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.410234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.411909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.416066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59f28203e3264ac09ee5b76be141e41b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59f28203e3264ac09ee5b76be141e41b. Mar 20 16:05:46.422909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 486/951] 10.222.0.18 () {60 vars in 1140 bytes} [Sun Mar 20 16:05:46 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:46.424166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.434733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:46.441679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 466/952] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:46.443643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.548933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034378-15a6-4f76-aa9d-8e7b872fbb4f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.553127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6211db-9710-4450-9f28-982b910875b6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.583543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.584128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.584482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.584876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.585942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:46.586288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.587920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.594361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.595473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.595950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.596894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.605432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.609376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.609655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 467/953] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:46.611094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.623096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:46.624457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 487/954] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:46.629933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.724174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aae105-d389-46ae-9c80-a4d8d1e82298 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.737673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26834d-2728-495a-af6d-de6f46fc06bd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.764986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.766298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.766936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.767751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.769146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:46.769688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.771763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.772450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.773363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.773710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.774099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.781720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.783382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.799725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-78e142f3-098a-4781-88d8-5eab32b61d9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 20 16:05:46.805966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 488/956] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:46.806764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 468/956] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:46.808399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:46.890570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1809-fb64-406a-a093-e9ddbd545811 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.890767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1809-fb64-406a-a093-e9ddbd545811 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.891026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1809-fb64-406a-a093-e9ddbd545811 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.893300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 469/957] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:46.899817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041abc-731d-487d-83bf-f815e614543d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.900096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041abc-731d-487d-83bf-f815e614543d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.900530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a041abc-731d-487d-83bf-f815e614543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.922186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1a041abc-731d-487d-83bf-f815e614543d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:46.923627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1a041abc-731d-487d-83bf-f815e614543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:46.924670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ddd-31bb-4d4d-8c08-f2894b817128 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:46.968121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:46.970114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:46.970623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:46.971044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:46.972081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:46.972537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:46.974152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:46.999279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 489/958] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:47.000871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.010571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 470/959] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:47.032331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a041abc-731d-487d-83bf-f815e614543d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.119559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89bf5-f215-4988-94a7-2644aea91dd9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.152267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a041abc-731d-487d-83bf-f815e614543d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.153845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.154746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.155203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.155646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.185766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.186605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.186935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.187209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.187885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.189325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.200794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 20 16:05:47.202327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 471/960] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:47.208176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.226425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.228167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9c68-1ff4-4d72-be0a-c68e112eb6cd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.304530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73a14-2315-4888-ad3f-58707c1f22ab None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.327739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 490/961] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:05:47.327739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443b205-8ca9-494b-8d85-11958105c82e None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.327739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443b205-8ca9-494b-8d85-11958105c82e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.327739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443b205-8ca9-494b-8d85-11958105c82e None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.327739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 491/962] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:47.329670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443b205-8ca9-494b-8d85-11958105c82e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.348690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.349412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.349685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.349953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.350711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:47.351010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.352364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8e7e6-3ae1-4bdb-849c-9ebaca71b63f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.357121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 472/963] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:47.358177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.358496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.358820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.377046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:47.378221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:47.435020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443b205-8ca9-494b-8d85-11958105c82e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.447234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 473/964] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:47.447234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.467456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.468258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.468536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.468805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.478491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.479928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.496425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:47.502081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 492/965] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:47.502081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.548090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bcee0-bcc4-420f-baca-8de0445a341f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.580246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.580910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.581192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.581466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.582174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:47.582509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.583879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.598327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 474/966] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:47.598327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.605896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daedc5-6718-43b4-88cb-545473b3bb0d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.649201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.650193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.650508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.651104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.652051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.654039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.668868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 20 16:05:47.670573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 493/967] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:47.676876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.698398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893ddad-103f-491d-bff8-f62c4a01223e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.735071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.735906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.736252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.736596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.737393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:47.737761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.739574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.752685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 475/968] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:47.764140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.813826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f177-b7e3-4e40-9bf7-000f2b7ff943 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.848432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.849098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.849369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.849636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.850358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:47.850657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.852028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.857216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 494/969] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:47.863210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.872675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5f646-532a-4608-9813-5f5b1ae311cd None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:47.905692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:47.906540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:47.906819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:47.907088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:47.918684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:47.921618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:47.939986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:05:47.941964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 476/970] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:47.950454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:47.974054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09ff4a-064a-4bdd-bb43-3573b8a1978c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:48.007744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:48.008428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:48.008710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:48.008976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:48.009699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:48.009994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:48.011471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:48.017387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 495/971] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:48.024644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:48.053243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e06e-9133-44bb-9911-f14653b6107d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:48.086754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870961df-213a-42ae-b956-00da98073d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:48.087554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870961df-213a-42ae-b956-00da98073d32 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:48.087906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870961df-213a-42ae-b956-00da98073d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:48.088248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870961df-213a-42ae-b956-00da98073d32 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:48.089123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870961df-213a-42ae-b956-00da98073d32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:48.089501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870961df-213a-42ae-b956-00da98073d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:48.091015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870961df-213a-42ae-b956-00da98073d32 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:48.103609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 477/972] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:48.109465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870961df-213a-42ae-b956-00da98073d32 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:48.139468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba21cd-eac7-4ead-9136-6db541d9ba40 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:48.172165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:48.172920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:48.173270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:48.173636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:48.174683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:48.175967 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724dd5c-376d-438f-b01a-d0b6cd5ed215 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:48.198129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 496/973] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:48.219965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870961df-213a-42ae-b956-00da98073d32 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:48.264224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:48.265279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:48.265773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:48.266307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:48.267420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] RBAC: Adding query filter params (role.id=ba32378df9354a9f872e43f524405761, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=c40f1d846a554956a0d471e5718b8244) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:48.267917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:48.269659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5353a9-e1e7-4ae4-ba30-e22ca334fc56 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:48.277075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 478/974] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:05:48 2022] GET /identity/v3/role_assignments?user.id=c40f1d846a554956a0d471e5718b8244&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=ba32378df9354a9f872e43f524405761 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:49.200584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783812bb-3927-475b-beb3-28d83ea70cb5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.201102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783812bb-3927-475b-beb3-28d83ea70cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.201204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783812bb-3927-475b-beb3-28d83ea70cb5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.203249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 497/975] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:49.209095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.209553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.209746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.228897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:49.230087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:49.300366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 479/976] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:49.325319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783812bb-3927-475b-beb3-28d83ea70cb5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:49.429108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783812bb-3927-475b-beb3-28d83ea70cb5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:49.464177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:49.464772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.465055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.465330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.466039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:49.467511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:49.481852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.sql.core [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 20 16:05:49.481852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 20 16:05:49.481852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [parameters: {'user_id': '93293742f6394291b759305ea8d40bc3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 20 16:05:49.481852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79876) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 20 16:05:49.488099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 20 16:05:49.493739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 498/977] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Mar 20 16:05:49 2022] POST /identity/v3/users => generated 160 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:49.499476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:49.598871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f84a56-5c03-4705-9ab1-3d89a8b836f8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:49.634208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:49.635050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.635335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.635614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.644362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:49.646137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:49.660607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-fed45919-3f1f-4df2-9e68-e8832ab9d924 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 20 16:05:49.662392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 480/978] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:05:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:49.668304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:49.766969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84730780-b3ce-4f7c-98b5-8fab77875d37 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:49.800245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:49.800928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.801214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.801489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.802331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:49.802641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:49.804295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42268b-0528-4805-bac8-afdb58e2ec44 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:49.846611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 499/979] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Mar 20 16:05:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:49.950791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe03fc-cf1a-43b7-af29-c5ace6ef8870 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.951156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe03fc-cf1a-43b7-af29-c5ace6ef8870 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.951340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe03fc-cf1a-43b7-af29-c5ace6ef8870 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.953512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 481/980] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:49.959359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18852a-548d-4ac9-b5d4-ddbc8e561c07 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:49.959709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18852a-548d-4ac9-b5d4-ddbc8e561c07 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:49.959916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18852a-548d-4ac9-b5d4-ddbc8e561c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:49.977994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2a18852a-548d-4ac9-b5d4-ddbc8e561c07 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:49.979595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2a18852a-548d-4ac9-b5d4-ddbc8e561c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:50.049716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 500/981] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:50.072263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe03fc-cf1a-43b7-af29-c5ace6ef8870 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:50.175851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe03fc-cf1a-43b7-af29-c5ace6ef8870 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:50.213199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:50.213973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.214249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.214544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.215270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:50.216641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906632e5-69fe-4b8c-be10-50aadc911621 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:50.236092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 482/982] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:50 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:50.517537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771530-4777-4812-9b14-5ad1607bc76b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.518046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771530-4777-4812-9b14-5ad1607bc76b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.518046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771530-4777-4812-9b14-5ad1607bc76b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.519975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 501/983] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:50.525088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c46a-0b86-44f0-bac6-46d50a28592b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.525383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c46a-0b86-44f0-bac6-46d50a28592b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.525617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c46a-0b86-44f0-bac6-46d50a28592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.542702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1a19c46a-0b86-44f0-bac6-46d50a28592b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:50.543865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1a19c46a-0b86-44f0-bac6-46d50a28592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:50.617846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 483/984] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:50.640431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771530-4777-4812-9b14-5ad1607bc76b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:50.725724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec572ac-715f-48c7-bd57-e6f428a74a8c None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.725724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec572ac-715f-48c7-bd57-e6f428a74a8c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.725724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec572ac-715f-48c7-bd57-e6f428a74a8c None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.725724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 484/985] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:50.731134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.731394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.731678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.742040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771530-4777-4812-9b14-5ad1607bc76b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:50.748713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:50.749890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:50.776376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:50.777106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.777384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.777650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.778319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:50.779681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:50.790718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 20 16:05:50.792083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 502/986] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:50.797779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:50.816681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 485/987] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:50.838677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:50.894607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d491-2bd6-46fc-9f98-e1020b06a12d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:50.927422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:50.928084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.928366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.928636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.929342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:50.929653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:50.931044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:50.935095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbda0a-11a2-424f-87a9-9d67c6f80ec8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:50.940672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 503/988] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:50.941520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:50.975033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:50.975827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:50.976102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:50.976370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] PATH_INFO: `/v3/services/image` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:50.977023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:50.978425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:50.989032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 20 16:05:50.990756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 486/989] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Mar 20 16:05:50 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:50.996383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:51.040944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa0874-0ada-4235-b05b-0266694f02b0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:51.076337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:51.077009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:51.077284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:51.077560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:51.078299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:51.078608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:51.080042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:51.085059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 504/990] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:51.090813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:51.092551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa7d0-d0ba-446e-9ff6-6db5040d7257 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:51.129966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:51.130692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:51.130974 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:51.131252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:51.131983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] RBAC: Adding query filter params (name=image) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:51.132323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:51.133726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:51.142293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 487/991] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:51.143893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:51.197291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420306b-4f0a-49c3-a5ba-f4d946b1f51e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:51.234659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:51.235322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:51.235602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:51.235909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:51.236700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] RBAC: Adding query filter params (interface=admin, service_id=3d188ae3a9dd4ad387b2c44333105669, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:51.237007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:51.238405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:51.242368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4e4d-0306-4da6-9265-37af49c68ce9 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:51.243747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 505/992] 10.222.0.18 () {56 vars in 1249 bytes} [Sun Mar 20 16:05:51 2022] GET /identity/v3/endpoints?service_id=3d188ae3a9dd4ad387b2c44333105669&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:51.248887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:51.274809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:51.275479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:51.275763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:51.276039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:51.276747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] RBAC: Adding query filter params (type=image) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:51.277051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:51.278447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289456e5-edcf-4551-a9bc-d76e74bfc39c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:51.292956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 488/993] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:51.356876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c34e-ec66-49c9-8ca9-140307bf7e57 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:51.395220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:51.395902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:51.396179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:51.396452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:51.397134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:51.398550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ce4b-55a0-43ee-b6ff-7dddc327e430 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:51.405292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 506/994] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:51 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:05:52.528468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6baf9-1b9e-458a-9f2f-1935458d46b5 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:52.529186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6baf9-1b9e-458a-9f2f-1935458d46b5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:52.529186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6baf9-1b9e-458a-9f2f-1935458d46b5 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:52.534302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 489/995] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:52.536630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:52.537049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:52.537225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:52.554203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:52.555432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:52.629600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 507/996] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:52.652378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6baf9-1b9e-458a-9f2f-1935458d46b5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:52.748036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6baf9-1b9e-458a-9f2f-1935458d46b5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:52.778441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:52.779289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:52.779515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:52.779781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:52.780422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:52.781779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:52.792394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 20 16:05:52.793700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 490/997] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:52.799557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:52.895019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b95596-0855-49f9-b194-3df40d2f09ef None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:52.929056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:52.929750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:52.929992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:52.930272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:52.930987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:52.931281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:52.932647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:52.937595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 508/998] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:52.943170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:53.041275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8045-f6d3-4290-9d39-725fa7f84571 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:53.074420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:53.075072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.075349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.075618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.076316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:53.076612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:53.078019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:53.083034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 491/999] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:53.088673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:53.186873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43a869-d031-453c-b6a3-86905d37a9e7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:53.231441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:53.232121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.232370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.232666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.233463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] RBAC: Adding query filter params (interface=public, service_id=b9bd8b176f6944f2b5c4dfae7da5b961, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:53.233742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:53.235180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a787-f564-4fd4-a9f5-ab9887063f22 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:53.241175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 509/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:53 2022] GET /identity/v3/endpoints?service_id=b9bd8b176f6944f2b5c4dfae7da5b961&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:53.246711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:53.346734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3793-6bc1-4ea6-8ae3-38b474b49bf1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:53.382671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:53.383332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.383608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.383880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.384558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:53.385918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38156-9279-4246-b8fc-ffcbba71f065 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:53.392256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 492/1001] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:53 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:05:53.574051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9bc87-1224-4b98-be17-28d2265894c5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.574582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9bc87-1224-4b98-be17-28d2265894c5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.574658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9bc87-1224-4b98-be17-28d2265894c5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.576385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 510/1002] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:53.581993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d45f-aa77-4141-b480-6fdaee790a6e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.582475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d45f-aa77-4141-b480-6fdaee790a6e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.582576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d45f-aa77-4141-b480-6fdaee790a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.600261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3300d45f-aa77-4141-b480-6fdaee790a6e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:53.601756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3300d45f-aa77-4141-b480-6fdaee790a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:53.668591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 493/1003] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:53.691350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9bc87-1224-4b98-be17-28d2265894c5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:53.699968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f27d-6ae1-42ec-bd67-1d9f4c2e87f0 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.700241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f27d-6ae1-42ec-bd67-1d9f4c2e87f0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.700493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f27d-6ae1-42ec-bd67-1d9f4c2e87f0 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.702447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 494/1004] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:53.707289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.707570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.707810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.725123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:53.726276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:53.790390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9bc87-1224-4b98-be17-28d2265894c5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:53.794432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 495/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:53.813986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:53.826950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:53.827773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.828394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.828667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.829684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:53.831490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:53.845950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 511/1006] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:53 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:53.920917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08e38-dcc3-46f7-a64e-150cca035f6b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:53.963231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:53.964045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:53.964322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:53.964592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:53.965268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:53.966675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:53.978788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 20 16:05:53.980280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 496/1007] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Mar 20 16:05:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:53.986816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:54.085703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397bb1-7414-436e-92c7-028d694d12e6 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:54.118962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:54.119620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:54.119893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:54.120143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:54.121038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:54.121340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:54.122719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:54.127795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 512/1008] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:54.133267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:54.234249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbf96-8401-4d3d-9ba9-9a9d583a80c7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:54.265983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:54.266899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:54.267400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:54.267821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:54.268660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:54.269102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:54.270661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd8fae-e8c3-48e9-a0c9-9a980204d59c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:54.279923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 497/1009] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Mar 20 16:05:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:54.281171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:54.376914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2582-21ac-4fcc-b309-75c44fc0dddd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:54.409465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:54.410436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:54.410928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:54.411387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:54.412297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:54.413849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a00ee-9175-4374-946e-7fa08d3a3ff2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:54.438288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 513/1010] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:05:55.677661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e100f-2125-4f0d-bdd6-34b64f6bc598 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:55.678191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e100f-2125-4f0d-bdd6-34b64f6bc598 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:55.678191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e100f-2125-4f0d-bdd6-34b64f6bc598 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:55.680059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 498/1011] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:55.685394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:55.685921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:55.685921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:55.703091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:55.704258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:55.778051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 514/1012] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:55.801153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e100f-2125-4f0d-bdd6-34b64f6bc598 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:55.903039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e100f-2125-4f0d-bdd6-34b64f6bc598 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:55.936340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:55.937073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:55.937357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:55.937629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:55.938289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:55.939696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:55.950671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 20 16:05:55.952096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 499/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:05:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:55.958007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.053976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa69b4-3ee5-4735-a4aa-03d144db198f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.088298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.088965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.089217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.089511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.090210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] RBAC: Adding query filter params (name=compute) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:56.090538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.091893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2576c2-1f6a-44a7-903f-d7275813d63b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.097034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 515/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:56.102795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.126487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6076-20f9-49a9-84a2-ff6a09a82bc5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.126767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6076-20f9-49a9-84a2-ff6a09a82bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.127037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6076-20f9-49a9-84a2-ff6a09a82bc5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.128846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 516/1015] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:56.133934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.134214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.134547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.152315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:56.153477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:56.205432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe8184-0bcb-4771-8c3c-c2ee65307054 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.226299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 517/1016] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:56 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:56.238750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.239748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.240029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.240302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.241002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] RBAC: Adding query filter params (type=compute) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:56.241303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.242701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.247370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 500/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:56.247541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.252951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.345252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4755a-f7d6-4d5f-98c4-c7b01e054634 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.346636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22af4c6-8981-4ffa-a337-9ab338d52e7f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.381891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.382575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.382855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.383128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.383414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.383858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.384196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.384467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.384735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] PATH_INFO: `/v3/services/image` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.385202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.385375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.386875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.398727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 20 16:05:56.399911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 518/1018] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:56.405717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.414719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 501/1019] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:05:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:56.511159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59009-4486-44fe-97de-4544a26c1f57 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.553140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.553866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.554151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.554451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.555165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] RBAC: Adding query filter params (name=image) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:56.555469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.556922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.562525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 519/1020] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:56.568291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.670989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2141-ceb6-458a-a51a-8268cdcd0a8a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.703849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.704592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.704870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.705137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.705838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] RBAC: Adding query filter params (type=image) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:56.706136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.707650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aacfd8-3f7d-43c3-84e1-5c0d23029220 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.712613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 502/1021] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:56.718685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.721951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149b4d1-1146-4722-a45f-a3514449cb87 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.722233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149b4d1-1146-4722-a45f-a3514449cb87 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.722550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149b4d1-1146-4722-a45f-a3514449cb87 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.724407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 503/1022] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:56.729371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.729653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.729981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.746849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:56.748007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:56.812813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 504/1023] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:56.815458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccf7d-bfff-4d8d-9db9-71da6121bc1b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.835830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.851082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.851754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.852184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.852467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.853560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] RBAC: Adding query filter params (interface=public, service_id=90e03bb57ced4a6386170d2d8471a197, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:56.853871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.855296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.860358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 520/1024] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/endpoints?service_id=90e03bb57ced4a6386170d2d8471a197&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:56.866215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.931141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f76e9-a723-405c-adfc-069101bc1afd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.959713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed6827-577b-4c77-b9e9-e6b2de3e9878 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:56.963167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.963971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.964251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.964523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.965690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.967162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:56.968930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 505/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:56.974438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:56.992084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:56.992747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:56.993191 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:56.993468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:56.994140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:56.995626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7801e5b-8e17-4cfb-ab98-f1a35a489ebc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:57.002165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 521/1026] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:05:56 2022] GET /identity/v3/services => generated 1957 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:05:57.079077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425adba1-87a5-4d42-9829-baf801ffd4ab None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:57.116551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:57.117491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:57.117961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:57.118409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:57.119270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:57.120882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0935e8d-e36b-4bdb-87fb-7ee7585ba05c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:57.150139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 506/1027] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:05:56 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:05:58.769683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2e8-ed91-40d0-8815-06d53b591262 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:58.770299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2e8-ed91-40d0-8815-06d53b591262 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:58.770299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2e8-ed91-40d0-8815-06d53b591262 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:58.771983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 522/1028] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:58.777462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:58.777914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:58.777990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:58.795055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:58.796211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:58.862628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 507/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:58.885650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf2e8-ed91-40d0-8815-06d53b591262 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:58.995998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf2e8-ed91-40d0-8815-06d53b591262 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.029022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.029833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.030105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.030385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.040694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:05:59.048008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:05:59.049439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 523/1030] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:05:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:59.055227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.156459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1133749-3f57-45ec-ae97-148d6370d565 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.190061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.190752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.191026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.191289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.192027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:59.192322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.193689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038c57a-da75-49ed-b0c1-d728d1f82784 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.201625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 508/1031] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:59.210372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.289204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7379-af90-43e7-bfa1-5a1fb345c097 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.289415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7379-af90-43e7-bfa1-5a1fb345c097 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.289643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7379-af90-43e7-bfa1-5a1fb345c097 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.294283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 509/1032] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:05:59.296470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.296826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.297101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.308278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa58fa-857f-4952-abae-37452fede24f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.318169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:59.320255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:59.341733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.342564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.342838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.343106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.353195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.354658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.371392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:05:59.372545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 524/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:59.378217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.394282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 510/1034] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:05:59.416580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.476173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03113c2-8961-4657-ad19-a07bf8cf5c20 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.507136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.507782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.508207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.508478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.509155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64497a1-fd3f-4617-9f1a-bdfcc220a814 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.509294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:59.509471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.510852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e36af-4372-4f53-aa1a-5d6eafeb8eb6 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.522496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 525/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:05:59.523580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254f5b-d6b3-4d21-b140-395faf34c131 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.523867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254f5b-d6b3-4d21-b140-395faf34c131 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.524135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254f5b-d6b3-4d21-b140-395faf34c131 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.525869 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 526/1036] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:05:59.528016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254f5b-d6b3-4d21-b140-395faf34c131 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.542638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.543369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.543646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.543916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] PATH_INFO: `/v3/services/image` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.544568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.545933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.556519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f739bd1f-8fc2-4f05-b14f-5f5d67f19da6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 20 16:05:59.557647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 511/1037] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/services/image => generated 86 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:05:59.559080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.559080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.559304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.576675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:05:59.577840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:05:59.623484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254f5b-d6b3-4d21-b140-395faf34c131 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.642565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 512/1038] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:05:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:05:59.643362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.662970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.663776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.664054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.664324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.671587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.673029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.686285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:05:59.687439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 527/1039] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:05:59.688180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.735997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fc971-8300-413d-8ec1-6d13a8a2621d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.767487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.768134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.768411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.768681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.769365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] RBAC: Adding query filter params (name=image) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:59.769660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.771044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.775703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 513/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:59.776449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.781403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72b09-2256-4b61-afda-48faaf5d9a58 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.814355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.815087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.815365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.815628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.816788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.818202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.819800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 528/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:59.820554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.871310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2f047-ae8d-48f2-b392-7fec1c982f3f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.903088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.903728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.904015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.904282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.905078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:59.905378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.906827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.912620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a678f-bfd2-486b-a666-87943279c7b8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:05:59.923402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 514/1042] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:59.924236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:05:59.947048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:05:59.947713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:05:59.947986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:05:59.948281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:05:59.948944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] RBAC: Adding query filter params (type=image) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:05:59.949260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:05:59.950718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:05:59.955365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 529/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:05:59.956122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.016112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd33-cadc-4394-8487-48e7ff6243c4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.051311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.051968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.052243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.052511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.053199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.054647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.063517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167bcc-9f85-4a62-b1c1-a2104c44fba5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.075822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 515/1044] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:05:59 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:00.076533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.097956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.098679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.099008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.099283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.168718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.170365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.179005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec536-ba2d-4ad6-8b14-0317808db5a4 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.213206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.213555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.213807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.214074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.215098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.216389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.239996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 516/1045] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:06:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:00.281397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 530/1046] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:05:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:00.287720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.400762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a32e7-f809-47f8-8e0c-690e7ee6d64f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.434980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.435841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.436124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.436392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.447976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.449421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.465886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:00.467458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 517/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:00.473453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.568570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d40f3-edde-4bfb-a2ec-3c7ea8f7fa8c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.603122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.603781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.604053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.604320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.605026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:00.605320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.606741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.618070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 531/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:00.625346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.722768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a835c-5cc2-46ba-87d2-51ff2e58a225 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.755173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.755960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.756230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.756497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.762874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.764302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.777202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:06:00.778552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 518/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:00.784357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:00.881765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469801-3066-4a67-b378-49f088f44053 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:00.917490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291771-94aa-45c1-9520-154c6964069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:00.918151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291771-94aa-45c1-9520-154c6964069d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:00.918411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291771-94aa-45c1-9520-154c6964069d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:00.918704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291771-94aa-45c1-9520-154c6964069d None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:00.919466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291771-94aa-45c1-9520-154c6964069d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:00.919764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291771-94aa-45c1-9520-154c6964069d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:00.921190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291771-94aa-45c1-9520-154c6964069d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:00.938960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 532/1050] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:00.940314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:01.040791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089484-0b90-4895-8ac8-9e24c0d52c94 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:01.074480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:01.075114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:01.075388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:01.075654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:01.076471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] RBAC: Adding query filter params (role.id=ba32378df9354a9f872e43f524405761, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:01.076855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:01.078192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab728-8463-4969-9380-b91f25ce974b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:01.083863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 519/1051] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:00 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=ba32378df9354a9f872e43f524405761 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:02.445377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346371e-90d0-4bee-aeb0-8bc3a9303fed None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.445948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346371e-90d0-4bee-aeb0-8bc3a9303fed None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.445948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346371e-90d0-4bee-aeb0-8bc3a9303fed None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.447725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 533/1052] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:02.453244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676ce7e-a338-4810-a2cf-ea3bb1de7666 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.453688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676ce7e-a338-4810-a2cf-ea3bb1de7666 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.453767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676ce7e-a338-4810-a2cf-ea3bb1de7666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.470982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e676ce7e-a338-4810-a2cf-ea3bb1de7666 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:02.472071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e676ce7e-a338-4810-a2cf-ea3bb1de7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:02.540563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 520/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:02.556513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b006c8-5f6f-4e9e-a161-701007eb2c80 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.556800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b006c8-5f6f-4e9e-a161-701007eb2c80 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.557072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b006c8-5f6f-4e9e-a161-701007eb2c80 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.559093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 534/1054] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:02.564516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.564796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.565067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.567004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b006c8-5f6f-4e9e-a161-701007eb2c80 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:02.584542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:02.585711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:02.650090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 521/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:02.664409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b006c8-5f6f-4e9e-a161-701007eb2c80 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:02.672636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:02.698687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:02.699509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.699783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.700034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.710859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:02.717667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:02.719049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 535/1056] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:02.725309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:02.767406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcfabe-7faa-4534-82b0-7645b3413ee1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:02.800400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:02.801053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.801333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.801604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.819282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a4e1-7f85-488f-bd32-22e9820baae4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:02.850380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:02.851054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:02.851328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:02.851596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:02.852389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:02.852630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:02.854070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:02.862232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 536/1057] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:02.866506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:02.868084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:02.868479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:02.963406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693ab6-4b02-4279-b908-f0ee2b088b6f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:02.973865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 522/1058] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:06:02.975476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.002240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.003143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.003421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.003692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] PATH_INFO: `/v3/users/71d6bcdcb5684520b39bcf1775bb6f90` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.016809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] RBAC: Authorizing `identity:get_user(user_id=71d6bcdcb5684520b39bcf1775bb6f90)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.018508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.020043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 537/1059] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:02 2022] GET /identity/v3/users/71d6bcdcb5684520b39bcf1775bb6f90 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:03.025506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.075884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3ea3-4157-4a7a-ba1e-36a3826173b7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.108599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.109389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.109667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.109935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.119931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.121371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.123860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b0ba9-6fd8-4131-93c6-312f00bf46c8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.137476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:03.138837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 523/1060] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:03.144938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.157270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.157982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.158283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.158558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.231761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.233148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.243563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b5ba-942b-4002-9101-6172a21e4372 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.280170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.280833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.281113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.281384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.282107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:03.282448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.283864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d403ae-5b1a-4d1b-936c-30959e1a06f9 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.295137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 524/1061] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:03.323206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0442a-be52-488b-a4ee-03721135bfb2 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.323552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0442a-be52-488b-a4ee-03721135bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.323755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0442a-be52-488b-a4ee-03721135bfb2 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.325732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 525/1062] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:06:03.331473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.331792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.332012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.337825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 538/1063] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:06:03.338934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.353423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:03.354660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:03.422316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 526/1064] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:06:03.441496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875208fb-642c-4d7d-a823-757b383cd3c0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.444824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.476369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.478385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.478385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.478385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.479433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.480898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.483042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 539/1065] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:03.488650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.542686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5d7f-97ca-45dc-ba8b-e6b5029c106d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.590616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.591972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.592562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.593092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.596242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7fac8-8ef6-4656-ac8e-01087d6e19a9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.606553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:03.615484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:06:03.617270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 527/1066] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:03.623228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.637137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.637810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.638087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.638434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.639267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=29f97f4deb024c3685920d10113f8e7b, user.id=71d6bcdcb5684520b39bcf1775bb6f90) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:03.639576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.641005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.646657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 540/1067] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/role_assignments?user.id=71d6bcdcb5684520b39bcf1775bb6f90&scope.project.id=29f97f4deb024c3685920d10113f8e7b&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:03.730410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ae7d-1b42-460e-81c4-4921b638bda3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.765382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.765980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.766275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.766558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.767350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:03.767651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.769038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.783099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 528/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:03.784052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:03.883363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c903e6-9adf-4b5c-a5f5-ac8e5af1747f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:03.914920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:03.915720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:03.915992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:03.916253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:03.925569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:03.927017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:03.943291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:03.944406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 541/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:06:03.950466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.048615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555236c9-b38b-4634-9867-6485b31a702d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.081364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.082010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.082280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.082577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.083290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:04.083590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.084948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.096418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 529/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:04.102174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.201582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfdd2b-5622-4ba0-9044-db37e2f8ef08 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.235450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.236621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.236897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.237167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.244366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.245797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.259006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:06:04.260146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 542/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:04.266009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.363363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182644c-0f3a-4b4e-be1c-81b0d34c0858 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.397128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.397789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.398065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.398361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.399180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:04.399484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.400910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.418946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 530/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:04.424823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.518911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a54dc-e7f7-4106-bb08-021193dc7309 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.553207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.553992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.554285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.554556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.564329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.565761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.582342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:04.583510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 543/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:04.589335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.686288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5cf35-8e58-4c00-a0dd-6f24fbf1bc2e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.719607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.720316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.720592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.720858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.721575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:04.721875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.723261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.734324 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 531/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:04.740560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:04.840057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab561-1837-4787-b05b-9fb7a8efd059 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:04.873207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:04.873980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:04.874279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:04.874545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:04.881096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:04.882551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:04.895356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:06:04.896503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 544/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:04.902469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:05.000072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7b78-d525-43d9-90be-9de212c4b42c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:05.032455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:05.033100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:05.033375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:05.033641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:05.034451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:05.034760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:05.036184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0351b-1ddf-4f9d-a8ec-572c1245c04d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:05.047992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 532/1076] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:05.054287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:05.151507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22037-0eb0-4a8b-890b-93417316bb3b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:05.184408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:05.185294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:05.185573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:05.185871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/ba32378df9354a9f872e43f524405761` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:05.188111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=8c61a24263474ff7926d416bedf11db7, role_id=ba32378df9354a9f872e43f524405761)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:05.189593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7a7e-e55f-41b3-9bf7-13eb4b62562f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:05.204357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 545/1077] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:06:05 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/8c61a24263474ff7926d416bedf11db7/roles/ba32378df9354a9f872e43f524405761 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:06:05.903419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bce79-287f-406c-bb0b-7990b325990f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:05.903986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bce79-287f-406c-bb0b-7990b325990f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:05.903986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bce79-287f-406c-bb0b-7990b325990f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:05.905715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 533/1078] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:05.911337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:05.911775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:05.911887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:05.928789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:05.929960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:05.994192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 546/1079] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:06:06.016769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bce79-287f-406c-bb0b-7990b325990f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:06.115579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bce79-287f-406c-bb0b-7990b325990f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:06.149149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:06.149936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:06.150214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:06.150553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:06.160351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:06.167161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:06.168321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 534/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:06.174502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:06.274815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88563a1-2fa6-4205-8e83-0d289ce1deaa None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:06.309982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:06.310717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:06.310970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:06.311241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:06.311994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:06.312297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:06.313672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:06.322284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 547/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:06.328273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:06.426190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640acd-19e4-4964-9dd2-f99fc44f6297 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:06.458983 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:06.459845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:06.460126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:06.460382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] PATH_INFO: `/v3/users/71d6bcdcb5684520b39bcf1775bb6f90` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:06.461586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] RBAC: Authorizing `identity:get_user(user_id=71d6bcdcb5684520b39bcf1775bb6f90)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:06.463049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:06.464822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 535/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:06 2022] GET /identity/v3/users/71d6bcdcb5684520b39bcf1775bb6f90 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:06.470474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:06.566938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e5808-5d4f-4a8c-9e02-95d657a3b753 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:06.599429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:06.600272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:06.600548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:06.600821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:06.602001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:06.603617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6d82-a255-4ff1-a936-c6f61f153dda None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:06.605292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 548/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:06 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:06.611678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:06.710734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f97c8-5586-4c27-a457-b71af73a7322 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:06.746384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:06.747281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:06.747559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:06.747828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b/users/71d6bcdcb5684520b39bcf1775bb6f90/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:06.749845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=29f97f4deb024c3685920d10113f8e7b, user_id=71d6bcdcb5684520b39bcf1775bb6f90, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:06.751369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d300fbc-4302-4068-95bd-e69a73ad0bf6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:06.764874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 536/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:06:06 2022] PUT /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b/users/71d6bcdcb5684520b39bcf1775bb6f90/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:06:07.444801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f837e3-d6be-4fa5-a406-0e9d7d0ce285 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:07.445328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f837e3-d6be-4fa5-a406-0e9d7d0ce285 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:07.445328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f837e3-d6be-4fa5-a406-0e9d7d0ce285 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:07.447297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 549/1085] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:07.452818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:07.453198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:07.453371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:07.472190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:07.473307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:07.540164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 537/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:07.563708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f837e3-d6be-4fa5-a406-0e9d7d0ce285 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:07.788062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f837e3-d6be-4fa5-a406-0e9d7d0ce285 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:07.821384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:07.822188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:07.822491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:07.822756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:07.832783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:07.840000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 20 16:06:07.841158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 550/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Mar 20 16:06:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:07.847402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:07.944397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ca18-6edc-4b0d-a03f-386eabe86f83 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:07.977152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:07.977804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:07.978076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:07.978371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:07.979108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:07.979400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:07.980760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:07.988541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 538/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:06:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:07.994410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:08.090282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977045e-8bc3-4584-93d4-74e12e9c3449 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:08.123523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:08.124303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:08.124577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:08.124847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:08.134952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:08.136427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:08.152809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:08.153950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 551/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:08.159845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:08.263426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15b42-132a-40b9-8f4d-2f0c98265a7e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:08.297255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:08.298023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:08.298392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:08.298727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:08.299521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:08.299905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:08.301341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:08.313711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 539/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:08.319554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:08.421358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27f05-3e76-4a1d-a98c-240c6f4e096f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:08.454650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:08.455492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:08.455774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:08.456033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:08.463010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:08.464436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:08.477776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 20 16:06:08.478960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 552/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Mar 20 16:06:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:06:08.484936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:08.582798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216dc6c-ba87-4125-b722-dae95e0a4bf1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:08.616766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:08.617423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:08.617702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:08.617973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:08.618831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:08.619132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:08.620557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:08.637912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 540/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Mar 20 16:06:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:08.643881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:08.745576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d0a9-5f13-4394-9925-c53ee1c029e8 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:08.778798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:08.779441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:08.779717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:08.779987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:08.845177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:08.846765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929081-f301-4d68-b2db-2e7684b45399 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:08.942127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 553/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:08.948003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.023575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de367d-d842-49f0-9628-e1d423217a0b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.023788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de367d-d842-49f0-9628-e1d423217a0b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.024018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de367d-d842-49f0-9628-e1d423217a0b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.025784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 554/1094] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:06:09.030698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.030968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.031220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.046114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5bcc8-4458-4b83-84d6-3546da4b3bf7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.047632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:09.048784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:09.077996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.078815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.079094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.079397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.089126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.090590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.107710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:06:09.108875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 541/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:09.114951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.115597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 555/1096] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:09.138839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.209362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8436a-6288-4a30-b040-c9e1d9b1a2c6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.233837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890f72a-9769-46f5-81b5-117e32994793 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.244184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.244849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.245126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.245394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.246122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:09.246442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.247850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.258687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 542/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:09.264256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.265882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.266710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.267066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.267338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.277049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:09.283899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:09.285035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 556/1098] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:06:09.292089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.356538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9d6c-f287-44d7-8a3a-aecf872e4d0f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.385450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b5436-2ec1-41a8-aa76-fc1358288f3c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.390279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.391077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.391355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.391625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.398133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.399610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.412633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:06:09.413781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 543/1099] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:06:09.416516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.417169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.417444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.417711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.418469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:09.418770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.419698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.420115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.428600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 557/1100] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:09.434098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.514471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4204-33eb-44ea-b6e0-c01c211dbc8f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.528475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f54e67-3385-4d38-90d7-dad7b247e04f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.547644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.548359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.548632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.548907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.549806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:09.550107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.551566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.561368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.562226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.562544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.562685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 544/1101] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:09.562799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] PATH_INFO: `/v3/users/71d6bcdcb5684520b39bcf1775bb6f90` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.564011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] RBAC: Authorizing `identity:get_user(user_id=71d6bcdcb5684520b39bcf1775bb6f90)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.565420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.567175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 558/1102] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/users/71d6bcdcb5684520b39bcf1775bb6f90 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:09.568441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.572512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.662285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25fef-3102-4b37-bf44-b76a60682230 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.665219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a86a1-d4fd-42c6-81a2-b7b1e59a980c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:09.694583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.695203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.695476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.695740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.698289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:09.698942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:09.699221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:09.699492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:09.700314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] RBAC: Adding query filter params (role.id=ba32378df9354a9f872e43f524405761, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=8c61a24263474ff7926d416bedf11db7) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:09.700617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.702032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.707731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 545/1103] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/role_assignments?user.id=8c61a24263474ff7926d416bedf11db7&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=ba32378df9354a9f872e43f524405761 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:09.764949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:09.766451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:09.871888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 559/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:06:09.877938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:09.976219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c76ef-62f5-46dd-ad87-fd3e1cda6d6c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:10.010141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:10.011035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:10.011313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:10.011581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:10.012757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:10.014198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66a0c-e4d0-4283-bbb0-81b435f1e42a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:10.015928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 546/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:09 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:10.022154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:10.117947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ab174-fe71-4d81-b796-a85776ba4d90 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:10.150697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8535275-7825-4537-951a-511bf039d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:10.151289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8535275-7825-4537-951a-511bf039d41a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:10.151570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8535275-7825-4537-951a-511bf039d41a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:10.151838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8535275-7825-4537-951a-511bf039d41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:10.152663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8535275-7825-4537-951a-511bf039d41a None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=29f97f4deb024c3685920d10113f8e7b, user.id=71d6bcdcb5684520b39bcf1775bb6f90) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:10.152970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8535275-7825-4537-951a-511bf039d41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:10.154526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8535275-7825-4537-951a-511bf039d41a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:10.160689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 560/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:10 2022] GET /identity/v3/role_assignments?user.id=71d6bcdcb5684520b39bcf1775bb6f90&scope.project.id=29f97f4deb024c3685920d10113f8e7b&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:12.446787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c74-3e86-419b-b321-9e586830cc41 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:12.447699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c74-3e86-419b-b321-9e586830cc41 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:12.447699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c74-3e86-419b-b321-9e586830cc41 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:12.450545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 547/1107] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:12.458510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:12.458925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:12.459025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:12.486436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:12.487591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:12.552270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 561/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:12.587875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a3c74-3e86-419b-b321-9e586830cc41 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:12.694367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a3c74-3e86-419b-b321-9e586830cc41 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:12.729184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:12.729898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:12.730177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:12.730478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:12.731772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:12.733193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0154f-6abb-4680-ab8a-bb2939263a1b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:12.734816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 548/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:12.740992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:12.840451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a87c4-a9af-4df4-acdd-3562e045873c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:12.874390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:12.875042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:12.875316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:12.875579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:12.876318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:12.877725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323ef8-ccb8-49ed-a4c5-bd44a8e49650 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:12.901030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 562/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:06:12 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:15.189434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f7b7-7afe-4114-b7af-0afa731315cc None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:15.190368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f7b7-7afe-4114-b7af-0afa731315cc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:15.190368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f7b7-7afe-4114-b7af-0afa731315cc None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:15.193342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 549/1111] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:15.199707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:15.200413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:15.200602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:15.225297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:15.226509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:15.295377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 563/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:15.319435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f7b7-7afe-4114-b7af-0afa731315cc None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:15.422736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f7b7-7afe-4114-b7af-0afa731315cc None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:15.457433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:15.458276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:15.458565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:15.458834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] PATH_INFO: `/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:15.460391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] RBAC: Authorizing `identity:get_role(role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:15.461795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:15.463175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 550/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:15 2022] GET /identity/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:15.472305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:15.592163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338653-0117-431e-82e5-c3e02a1f9721 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:15.627118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:15.627977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:15.628248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:15.628513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] PATH_INFO: `/v3/users/af63cf1b3a9e49cab340074251402939` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:15.641871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] RBAC: Authorizing `identity:get_user(user_id=af63cf1b3a9e49cab340074251402939)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:15.643329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:15.644942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 564/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:15 2022] GET /identity/v3/users/af63cf1b3a9e49cab340074251402939 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:15.651072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:15.751259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b106c2-3c8f-4e7b-ac44-c25958a660ce None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:15.784192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:15.784811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:15.785079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:15.785344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:15.851914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:15.853330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:15.947464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 551/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:15.956651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:16.052735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2fa6-0289-40ec-9994-75e896e8f69d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:16.086173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:16.087055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:16.087331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:16.087600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:16.088886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:16.090325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46d5ac-6d36-4c9a-a6af-ac038565418d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:16.092003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 565/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:15 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:16.098361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:16.210331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f829d7-48bc-4646-95f9-f70ae4a3b64c None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:16.254383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:16.255029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:16.255303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:16.255556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:16.256368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=29f97f4deb024c3685920d10113f8e7b, user.id=af63cf1b3a9e49cab340074251402939) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:16.256669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:16.258092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4112f4-19b9-4080-b303-c92c78816b78 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:16.263421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 552/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:16 2022] GET /identity/v3/role_assignments?user.id=af63cf1b3a9e49cab340074251402939&scope.project.id=29f97f4deb024c3685920d10113f8e7b&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:18.499042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932947a-c80b-4a46-b02d-727563e4de9c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:18.499583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932947a-c80b-4a46-b02d-727563e4de9c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:18.499583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932947a-c80b-4a46-b02d-727563e4de9c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:18.501310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 566/1118] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:18.507820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:18.508548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:18.508914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:18.530137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:18.531353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:18.598855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 553/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:18.626840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932947a-c80b-4a46-b02d-727563e4de9c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:18.730125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932947a-c80b-4a46-b02d-727563e4de9c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:18.764016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:18.764810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:18.765085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:18.765355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] PATH_INFO: `/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:18.767009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] RBAC: Authorizing `identity:get_role(role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:18.768366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:18.769705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 567/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:18 2022] GET /identity/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:18.776526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:18.901187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52e24-afb5-4e28-9e36-b34c079bc926 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:18.942457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:18.943470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:18.943742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:18.944001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] PATH_INFO: `/v3/users/af63cf1b3a9e49cab340074251402939` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:18.945281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] RBAC: Authorizing `identity:get_user(user_id=af63cf1b3a9e49cab340074251402939)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:18.946751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:18.948339 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 554/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:18 2022] GET /identity/v3/users/af63cf1b3a9e49cab340074251402939 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:18.954766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:19.055476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468f057-158a-4450-9001-89bb12b3ae83 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:19.088373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:19.089220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:19.089500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:19.089767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:19.091001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:19.092424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67735ccb-e2b1-4701-937f-2513e382e433 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:19.094072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 568/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:18 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:19.100917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:19.198234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30193-868a-44c2-9a97-187eca7385dc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:19.236676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:19.237569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:19.237850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:19.238119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b/users/af63cf1b3a9e49cab340074251402939/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:19.241074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] RBAC: Authorizing `identity:create_grant(project_id=29f97f4deb024c3685920d10113f8e7b, user_id=af63cf1b3a9e49cab340074251402939, role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:19.242547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2dbe-5b08-4f74-ab13-eabb49d12474 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:19.262516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 555/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:06:19 2022] PUT /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b/users/af63cf1b3a9e49cab340074251402939/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:06:21.481418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9451f-d9fc-4ecc-8f24-00f19ccb8225 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:21.481953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9451f-d9fc-4ecc-8f24-00f19ccb8225 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:21.481953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9451f-d9fc-4ecc-8f24-00f19ccb8225 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:21.483675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 569/1124] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:21.490517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:21.491233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:21.491409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:21.518088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:21.519297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:21.592522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 556/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:21.616073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9451f-d9fc-4ecc-8f24-00f19ccb8225 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:21.718069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9451f-d9fc-4ecc-8f24-00f19ccb8225 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:21.751619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:21.752401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:21.752675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:21.752941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] PATH_INFO: `/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:21.754472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] RBAC: Authorizing `identity:get_role(role_id=a0035d8c31e24d2cb7b1c97b97fb8b06)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:21.755836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:21.757185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 570/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:21 2022] GET /identity/v3/roles/a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:21.763314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:21.855700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f430a-6819-49e4-acd7-2e5dd51e7f00 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:21.889641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:21.890530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:21.890810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:21.891085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] PATH_INFO: `/v3/users/af63cf1b3a9e49cab340074251402939` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:21.892382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=af63cf1b3a9e49cab340074251402939)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:21.893817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:21.895430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 557/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:21 2022] GET /identity/v3/users/af63cf1b3a9e49cab340074251402939 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:21.901538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:22.002205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adfef2-e12d-4e70-b7df-ffec88d4eca7 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:22.035701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:22.036330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:22.036609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:22.036878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:22.101506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:22.102963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:22.197644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 571/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:22.205218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:22.305506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb72815-f036-49f3-97f1-518fd3976bd7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:22.339529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:22.340381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:22.340664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:22.340933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] PATH_INFO: `/v3/projects/29f97f4deb024c3685920d10113f8e7b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:22.342230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] RBAC: Authorizing `identity:get_project(project_id=29f97f4deb024c3685920d10113f8e7b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:22.343694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103056f-7871-45de-bc68-54505eb1f318 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:22.345377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 558/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:22 2022] GET /identity/v3/projects/29f97f4deb024c3685920d10113f8e7b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:22.352423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:22.452441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0af5a-3bf0-4075-8c41-375081cef1f4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:22.485020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:22.485683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:22.485952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:22.486215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:22.487042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] RBAC: Adding query filter params (role.id=a0035d8c31e24d2cb7b1c97b97fb8b06, scope.project.id=29f97f4deb024c3685920d10113f8e7b, user.id=af63cf1b3a9e49cab340074251402939) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:22.487343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:22.488773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bcf8e-0d0f-4f4f-bb6e-7ed256a5b851 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:22.496037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 572/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:22 2022] GET /identity/v3/role_assignments?user.id=af63cf1b3a9e49cab340074251402939&scope.project.id=29f97f4deb024c3685920d10113f8e7b&role.id=a0035d8c31e24d2cb7b1c97b97fb8b06 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:24.775806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a017e95-1017-45d0-bc30-1873821bc05a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:24.776406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a017e95-1017-45d0-bc30-1873821bc05a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:24.776406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a017e95-1017-45d0-bc30-1873821bc05a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:24.778132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 559/1131] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:24.784538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:24.785276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:24.785450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:24.813583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:24.814818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:24.881980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 573/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:24.915951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a017e95-1017-45d0-bc30-1873821bc05a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:25.020873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a017e95-1017-45d0-bc30-1873821bc05a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:25.055309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:25.056093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:25.056370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:25.056642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:25.057925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:25.059406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69552be-d78c-489a-9355-0c69025a7364 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:25.060970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 560/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:25.067605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:25.169544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb986cf-98b8-4662-9606-6e38158435c8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:25.206529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:25.207327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:25.208034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:25.208034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:25.208537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:25.209975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d12ed5-9ba5-4ea2-a92a-08ff8a35f1bd None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:25.242095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 574/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:06:25 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:27.536365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ccc7-a44a-4f40-9166-9cfcf83e8709 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:27.536928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ccc7-a44a-4f40-9166-9cfcf83e8709 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:27.536928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ccc7-a44a-4f40-9166-9cfcf83e8709 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:27.539724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 561/1135] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:27.547668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:27.548159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:27.548271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:27.566473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:27.567617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:27.632732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 575/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:06:27.661252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ccc7-a44a-4f40-9166-9cfcf83e8709 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:27.773083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ccc7-a44a-4f40-9166-9cfcf83e8709 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:27.806783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:27.807492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:27.807769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:27.808039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:27.809336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:27.810912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0f725-9fce-432f-a4da-89adb6312086 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:27.812500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 562/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:27.818475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:27.918593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e88e44-3716-49f8-99e3-a86d5999dd0c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:27.951236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:27.952116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:27.952447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:27.952761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:27.953467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:27.955444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e906f8-72be-4ced-842c-81244e3a5e6b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:27.976376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 576/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:06:27 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:30.272799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1db1-709e-4eb5-a17c-6b6ac5feb640 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:30.273678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1db1-709e-4eb5-a17c-6b6ac5feb640 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:30.273678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1db1-709e-4eb5-a17c-6b6ac5feb640 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:30.276615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 563/1139] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:30.282889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:30.283652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:30.283805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:30.307107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:30.308283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:30.375457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 577/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:30.405898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1db1-709e-4eb5-a17c-6b6ac5feb640 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:30.512684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1db1-709e-4eb5-a17c-6b6ac5feb640 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:30.546213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:30.547017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:30.547297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:30.547566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:30.558103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:30.565045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:30.566197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 564/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:30.572913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:30.675115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9fa3f-8417-4b05-bde6-247a6dbb8718 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:30.711074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:30.712019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:30.712390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:30.712759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:30.713915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:30.714325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:30.716464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:30.726117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 578/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:30.731813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:30.833073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea5fb-a80c-4970-b0ae-c57229e0f5e2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:30.866182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:30.867071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:30.867350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:30.867621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] PATH_INFO: `/v3/users/cce5333a2aca476f9dbe88428aab8819` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:30.880561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] RBAC: Authorizing `identity:get_user(user_id=cce5333a2aca476f9dbe88428aab8819)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:30.882013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:30.883653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 565/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:30 2022] GET /identity/v3/users/cce5333a2aca476f9dbe88428aab8819 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:30.890223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:31.002294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaa7dc-4443-4f94-83f9-8edb439cabcb None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:31.038790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:31.039416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:31.039690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:31.039957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:31.106612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:31.107965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:31.204499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 579/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:31.211184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:31.322524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff3066-2734-435a-aa30-a7dcef93858d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:31.356532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:31.357451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:31.357637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:31.357930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] PATH_INFO: `/v3/projects/6271e67f3360490bbb700a273ad0b1ac` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:31.359244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] RBAC: Authorizing `identity:get_project(project_id=6271e67f3360490bbb700a273ad0b1ac)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:31.360727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe545e3-fdbc-4c40-a844-439b6b1cbc0f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:31.362409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 566/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:31 2022] GET /identity/v3/projects/6271e67f3360490bbb700a273ad0b1ac => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:31.368913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:31.466163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a78b-8d4e-4a3d-b8e2-aafdee27380f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:31.503241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:31.503879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:31.504152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:31.504415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:31.505224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=6271e67f3360490bbb700a273ad0b1ac, user.id=cce5333a2aca476f9dbe88428aab8819) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:31.505527 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:31.506964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6776f-02bf-4a65-8b2b-24b7ceb85d36 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:31.512443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 580/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:31 2022] GET /identity/v3/role_assignments?user.id=cce5333a2aca476f9dbe88428aab8819&scope.project.id=6271e67f3360490bbb700a273ad0b1ac&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:33.775593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc675c0-d6df-42db-9c13-dd6ea5cbd9f6 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:33.776645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc675c0-d6df-42db-9c13-dd6ea5cbd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:33.776645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc675c0-d6df-42db-9c13-dd6ea5cbd9f6 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:33.779392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 567/1147] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:33.785154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:33.785599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:33.785699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:33.803563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:33.804753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:33.871086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 581/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:33.894433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc675c0-d6df-42db-9c13-dd6ea5cbd9f6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:34.007255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc675c0-d6df-42db-9c13-dd6ea5cbd9f6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:34.041479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:34.042289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:34.042570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:34.042845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:34.053445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:34.060400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:34.061577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 568/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:34.068113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:34.160462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35452-e4c5-46c6-9707-b57481f16c1a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:34.193990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:34.194674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:34.194925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:34.195217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:34.195951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:34.196255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:34.197612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:34.205621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 582/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:34.211692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:34.332971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cff0e-19da-453a-9689-b62848e724d3 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:34.366975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:34.367840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:34.368112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:34.368376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] PATH_INFO: `/v3/users/cce5333a2aca476f9dbe88428aab8819` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:34.369589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5333a2aca476f9dbe88428aab8819)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:34.371078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:34.372681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 569/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:34 2022] GET /identity/v3/users/cce5333a2aca476f9dbe88428aab8819 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:34.379393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:34.483715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2702f-86c0-42cd-89a9-2270116b042f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:34.517328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:34.518174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:34.518485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:34.518754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] PATH_INFO: `/v3/projects/6271e67f3360490bbb700a273ad0b1ac` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:34.520058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] RBAC: Authorizing `identity:get_project(project_id=6271e67f3360490bbb700a273ad0b1ac)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:34.521485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de89c15-d444-4dd2-a9e2-a96a0beadf0e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:34.523173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 583/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:34 2022] GET /identity/v3/projects/6271e67f3360490bbb700a273ad0b1ac => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:34.532596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:34.632204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e258798-af7a-469d-a040-96c22f739825 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:34.664768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:34.665643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:34.665915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:34.674301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] PATH_INFO: `/v3/projects/6271e67f3360490bbb700a273ad0b1ac/users/cce5333a2aca476f9dbe88428aab8819/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:34.676701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=6271e67f3360490bbb700a273ad0b1ac, user_id=cce5333a2aca476f9dbe88428aab8819, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:34.678162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876aa1c5-9d3c-482b-96c1-a1c087bc5f84 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:34.694613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 570/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:06:34 2022] PUT /identity/v3/projects/6271e67f3360490bbb700a273ad0b1ac/users/cce5333a2aca476f9dbe88428aab8819/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:06:36.947654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adbd0-5a5f-46dd-93e0-bd9ca1df6cfe None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:36.948507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adbd0-5a5f-46dd-93e0-bd9ca1df6cfe None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:36.948507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adbd0-5a5f-46dd-93e0-bd9ca1df6cfe None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:36.951460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 584/1154] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:36.957829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:36.958596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:36.958793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:36.980411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:36.981603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:37.047883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 571/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:37.083766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944adbd0-5a5f-46dd-93e0-bd9ca1df6cfe None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:37.188153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944adbd0-5a5f-46dd-93e0-bd9ca1df6cfe None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:37.224188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:37.224976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:37.225251 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:37.225516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:37.236371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:37.243445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:37.244597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 585/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:37.250766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:37.352391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b09f55-c4d2-4ca7-aca8-a9b1970ce4a9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:37.392936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:37.393639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:37.393914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:37.394178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:37.394950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:37.395248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:37.396612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:37.404918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 572/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:37.411453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:37.527997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9f75-a2b8-4724-b190-233cf7e406bb None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:37.561975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:37.562855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:37.563127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:37.563455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] PATH_INFO: `/v3/users/cce5333a2aca476f9dbe88428aab8819` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:37.564756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] RBAC: Authorizing `identity:get_user(user_id=cce5333a2aca476f9dbe88428aab8819)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:37.566168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:37.567800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 586/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:37 2022] GET /identity/v3/users/cce5333a2aca476f9dbe88428aab8819 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:37.573764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:37.675892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3dcb3-2a4a-4ab9-8a47-199ac19bada0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:37.710238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:37.710891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:37.711162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:37.711426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:37.782028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:37.783452 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:37.884491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 573/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:37.890736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:37.996117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edf045-3bfe-465e-a3a6-366b7a7d4de4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:38.027720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:38.028564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:38.028838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:38.029108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] PATH_INFO: `/v3/projects/6271e67f3360490bbb700a273ad0b1ac` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:38.030410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] RBAC: Authorizing `identity:get_project(project_id=6271e67f3360490bbb700a273ad0b1ac)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:38.031850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12719f-3a3c-4320-8cfa-4896c3871856 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:38.033650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 587/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:37 2022] GET /identity/v3/projects/6271e67f3360490bbb700a273ad0b1ac => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:38.040135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:38.146704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31c4b-9dc3-40cd-a943-cf60c6ac8f77 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:38.180342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:38.180971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:38.181241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:38.181504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:38.182323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=6271e67f3360490bbb700a273ad0b1ac, user.id=cce5333a2aca476f9dbe88428aab8819) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:38.182663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:38.184110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628be9e-49b7-4c72-9ff8-f9101ee5666e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:38.189935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 574/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:38 2022] GET /identity/v3/role_assignments?user.id=cce5333a2aca476f9dbe88428aab8819&scope.project.id=6271e67f3360490bbb700a273ad0b1ac&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:40.494763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777793-df58-408c-aebf-2c239b1fedc5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:40.495606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777793-df58-408c-aebf-2c239b1fedc5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:40.495606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777793-df58-408c-aebf-2c239b1fedc5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:40.498333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 588/1162] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:40.504836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:40.505270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:40.505360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:40.523559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:40.524724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:40.589897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 575/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:06:40.613711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19777793-df58-408c-aebf-2c239b1fedc5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:40.720908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19777793-df58-408c-aebf-2c239b1fedc5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:40.754642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:40.755204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:40.755479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:40.755742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:40.819631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:40.821052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:40.921002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 589/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:40.927425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:41.045185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746191c-9190-4a18-a7fc-7ae986a26fdb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:41.080727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:41.081526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:41.081800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:41.082066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:41.089065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:41.090542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:41.104829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f8fce991-67f3-4247-b5c4-7d4969bd956d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 20 16:06:41.105978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 576/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:06:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:41.112284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:41.210361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657144e-ecb2-4a3c-aa98-ead4adadf8ee None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:41.251678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:41.252323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:41.252597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:41.252863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:41.253573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:41.253870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:41.255257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a30992-dd41-4a18-ae67-97a038683db9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:41.262324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 590/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Mar 20 16:06:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:43.514208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078820-56e4-48be-b45f-31ea9c566569 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:43.515124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078820-56e4-48be-b45f-31ea9c566569 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:43.515124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078820-56e4-48be-b45f-31ea9c566569 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:43.517463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 577/1167] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:43.523842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2994-0c85-464d-a8fe-655fd3c9c6c1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:43.524290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2994-0c85-464d-a8fe-655fd3c9c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:43.524396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2994-0c85-464d-a8fe-655fd3c9c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:43.549811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b49c2994-0c85-464d-a8fe-655fd3c9c6c1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:43.551017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b49c2994-0c85-464d-a8fe-655fd3c9c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:43.630878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 591/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:43.657772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c078820-56e4-48be-b45f-31ea9c566569 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:43.767117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c078820-56e4-48be-b45f-31ea9c566569 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:43.799494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:43.800134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:43.800412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:43.800685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:43.801416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:43.802828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98bd0e-68f1-4abd-8493-dc9fb60a8ead None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:43.819365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 578/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Sun Mar 20 16:06:43 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:46.108641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a833c4-a91c-4d0c-9f0a-8e2b97b581f8 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:46.109548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a833c4-a91c-4d0c-9f0a-8e2b97b581f8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:46.109548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a833c4-a91c-4d0c-9f0a-8e2b97b581f8 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:46.112353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 592/1170] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:46.118334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:46.118751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:46.118863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:46.136597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:46.137773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:46.205441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 579/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:46.229085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a833c4-a91c-4d0c-9f0a-8e2b97b581f8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:46.328623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a833c4-a91c-4d0c-9f0a-8e2b97b581f8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:46.362247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:46.363059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:46.363336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:46.363605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] PATH_INFO: `/v3/domains/f436358b5b3c4a5d946a33b1244b7a4d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:46.374653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] RBAC: Authorizing `identity:get_domain(domain_id=f436358b5b3c4a5d946a33b1244b7a4d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:46.376142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db8fcd-910f-4f23-86ee-5a6f7035880b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:46.377730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 593/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Sun Mar 20 16:06:46 2022] GET /identity/v3/domains/f436358b5b3c4a5d946a33b1244b7a4d => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:46.383667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:46.485142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f324f6-a860-47ab-9548-1c0c665b0625 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:46.520160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:46.520808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:46.521084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:46.521356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:46.522052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:46.523513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e754c-0569-4c1e-80f2-46aba50b5c22 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:46.553257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 580/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:06:46 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:48.834391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e356b8-7345-477d-b3b5-478aae4ecc12 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:48.834971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e356b8-7345-477d-b3b5-478aae4ecc12 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:48.834971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e356b8-7345-477d-b3b5-478aae4ecc12 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:48.836704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 594/1174] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:48.843202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:48.843972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:48.844113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:48.868469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:48.869626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:48.936328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 581/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:48.967369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e356b8-7345-477d-b3b5-478aae4ecc12 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:49.070080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e356b8-7345-477d-b3b5-478aae4ecc12 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:49.102714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:49.103481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:49.103755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:49.104011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] PATH_INFO: `/v3/domains/f436358b5b3c4a5d946a33b1244b7a4d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:49.105184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f436358b5b3c4a5d946a33b1244b7a4d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:49.106636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcce86-dcc3-48c6-bc6b-081af62a7e19 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:49.108193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 595/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Sun Mar 20 16:06:48 2022] GET /identity/v3/domains/f436358b5b3c4a5d946a33b1244b7a4d => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:49.115173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:49.221535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b917-5b5c-434f-bc10-3595c7bac331 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:49.267564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:49.268220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:49.268494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:49.268759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:49.269454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:49.270916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a056f8-21e3-4a22-850e-be3d029d5972 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:49.297139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 582/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:06:49 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:06:51.610476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247c18-ca72-4277-b487-d9c2aefe1bee None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:51.611054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247c18-ca72-4277-b487-d9c2aefe1bee None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:51.611054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247c18-ca72-4277-b487-d9c2aefe1bee None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:51.612800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 596/1178] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:51.619663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:51.620114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:51.620217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:51.639811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:51.640980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:51.715039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 583/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:51.738378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21247c18-ca72-4277-b487-d9c2aefe1bee None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:51.847953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21247c18-ca72-4277-b487-d9c2aefe1bee None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:51.881599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:51.882321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:51.882628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:51.882887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:51.893109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:51.899978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:51.901173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 597/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:51.907612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:52.019660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abb9b-2f8d-4ff2-87eb-e2784875dbb8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:52.053243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:52.053885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:52.054159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:52.054459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:52.055195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:52.055490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:52.056846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:52.064682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 584/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:52.073698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:52.185452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f17a-baf6-4aad-bd68-48a30c5e2bbe None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:52.218983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:52.219927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:52.220207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:52.220481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] PATH_INFO: `/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:52.234571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] RBAC: Authorizing `identity:get_user(user_id=adf9a4131e5b4ff0b1afd69c9d461cd6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:52.236049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:52.237687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 598/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:52 2022] GET /identity/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:52.243957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:52.344753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c81d4-43b3-4112-a4e8-ac439cb7bf15 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:52.377797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:52.378461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:52.378741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:52.378993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:52.447725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:52.449113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:52.548255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 585/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:52.554555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:52.649428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7f7e-c6b6-49ae-b929-3eac28bbed9c None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:52.683362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:52.684203 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:52.684480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:52.684750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] PATH_INFO: `/v3/projects/388bf0ad88a5495d8268dfbb1e84b599` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:52.686046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=388bf0ad88a5495d8268dfbb1e84b599)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:52.687636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738a9dc-16c7-43e5-abd1-9d28cc36e6b5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:52.689346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 599/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:52 2022] GET /identity/v3/projects/388bf0ad88a5495d8268dfbb1e84b599 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:52.695771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:52.797195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee02a-ff2e-47d2-af72-21b3d8860267 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:52.830475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:52.831112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:52.831390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:52.831664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:52.832465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=388bf0ad88a5495d8268dfbb1e84b599, user.id=adf9a4131e5b4ff0b1afd69c9d461cd6) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:52.832768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:52.834202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0cf34-ecdf-408f-a45b-04a9b68ad4bf None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:52.839583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 586/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:52 2022] GET /identity/v3/role_assignments?user.id=adf9a4131e5b4ff0b1afd69c9d461cd6&scope.project.id=388bf0ad88a5495d8268dfbb1e84b599&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:55.082827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290398ff-a8af-42d5-aa43-aeba866dee45 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.083487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290398ff-a8af-42d5-aa43-aeba866dee45 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.083487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290398ff-a8af-42d5-aa43-aeba866dee45 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.086010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 600/1186] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:55.093933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.094491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.094612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.111539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:55.112718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:55.179916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 587/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:06:55.202304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290398ff-a8af-42d5-aa43-aeba866dee45 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:55.307294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290398ff-a8af-42d5-aa43-aeba866dee45 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:55.344083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:55.344867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.345143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.345414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.355166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:55.362049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:55.363255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 601/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:55.369868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:55.466015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166a75-0e73-4d28-a796-4c0fdee5af4f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:55.499763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:55.500410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.500726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.500997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.501735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:55.502034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:55.503430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:55.511247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 588/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:55.517411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:55.617472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e38a-14a6-4a98-b0f0-2202e8d7f385 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:55.650156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:55.651027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.651303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.651572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] PATH_INFO: `/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.652831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] RBAC: Authorizing `identity:get_user(user_id=adf9a4131e5b4ff0b1afd69c9d461cd6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:55.654290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:55.655888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 602/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:55 2022] GET /identity/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:06:55.664597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:55.764566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e4b5-1aa6-4cbb-bacd-6119c53ccfbf None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:55.800390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:55.801227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.801501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.801770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] PATH_INFO: `/v3/projects/388bf0ad88a5495d8268dfbb1e84b599` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.803034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=388bf0ad88a5495d8268dfbb1e84b599)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:55.804458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd746316-f93d-47d8-a83d-e993db62c0d5 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:55.806097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 589/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:55 2022] GET /identity/v3/projects/388bf0ad88a5495d8268dfbb1e84b599 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:55.812193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:55.915241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6f9b-947b-42b6-bc90-e8866c53ec9f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:55.948222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:55.949100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:55.949370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:55.949639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] PATH_INFO: `/v3/projects/388bf0ad88a5495d8268dfbb1e84b599/users/adf9a4131e5b4ff0b1afd69c9d461cd6/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:55.951838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] RBAC: Authorizing `identity:create_grant(project_id=388bf0ad88a5495d8268dfbb1e84b599, user_id=adf9a4131e5b4ff0b1afd69c9d461cd6, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:55.953276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baab4-530d-4310-8bb8-62bc05818501 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:55.969448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 603/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:06:55 2022] PUT /identity/v3/projects/388bf0ad88a5495d8268dfbb1e84b599/users/adf9a4131e5b4ff0b1afd69c9d461cd6/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:06:58.211357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcb74d-0d13-4eee-a9d2-1a4a86c5a74a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:58.211866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcb74d-0d13-4eee-a9d2-1a4a86c5a74a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:58.211866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcb74d-0d13-4eee-a9d2-1a4a86c5a74a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:58.213659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 590/1193] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:06:58.219767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:58.220194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:58.220383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:58.245434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:06:58.247271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:06:58.314136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 604/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:06:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:06:58.337150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcb74d-0d13-4eee-a9d2-1a4a86c5a74a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:58.450492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcb74d-0d13-4eee-a9d2-1a4a86c5a74a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:58.483936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:58.484651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:58.484933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:58.485265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:58.497416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:06:58.504317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:06:58.505458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 591/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:06:58.514422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:58.616411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad72db-f6d0-4b1f-be73-daac1fba64bc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:58.651380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:58.652033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:58.652304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:58.652574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:58.653311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:58.653609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:58.655001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:58.663650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 605/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:58.672729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:58.899719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e361c7f-81b5-483a-a6cb-d2ef0e41b1d1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:58.932814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:58.933656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:58.933929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:58.934195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] PATH_INFO: `/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:58.935512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] RBAC: Authorizing `identity:get_user(user_id=adf9a4131e5b4ff0b1afd69c9d461cd6)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:58.936917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:58.938616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 592/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Mar 20 16:06:58 2022] GET /identity/v3/users/adf9a4131e5b4ff0b1afd69c9d461cd6 => generated 311 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:58.944715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:59.052361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115883-5e19-41ad-99f4-072dfeede8bc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:59.085485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:59.086112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:59.086432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:59.086699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:59.151799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:59.153170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:59.248669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 606/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:06:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:06:59.254821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:59.351539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcfd4-84d8-4e95-9f3d-9e1d281d9504 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:59.396729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:59.397575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:59.397828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:59.398115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] PATH_INFO: `/v3/projects/388bf0ad88a5495d8268dfbb1e84b599` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:59.399442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] RBAC: Authorizing `identity:get_project(project_id=388bf0ad88a5495d8268dfbb1e84b599)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:59.400872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483975d5-184b-42aa-819a-f9bbc3baac22 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:59.402599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 593/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Mar 20 16:06:59 2022] GET /identity/v3/projects/388bf0ad88a5495d8268dfbb1e84b599 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:06:59.408720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:06:59.505232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be8c77-d5c6-455e-b2a2-6f039ee0ee93 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:06:59.539748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:06:59.540380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:06:59.540657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:06:59.540941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:06:59.541747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=388bf0ad88a5495d8268dfbb1e84b599, user.id=adf9a4131e5b4ff0b1afd69c9d461cd6) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:06:59.542057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:06:59.543499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f277e-a86b-46a0-b87d-94f2831b54ef None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:06:59.549204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 607/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:06:59 2022] GET /identity/v3/role_assignments?user.id=adf9a4131e5b4ff0b1afd69c9d461cd6&scope.project.id=388bf0ad88a5495d8268dfbb1e84b599&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:00.371469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b64b-83d9-43bb-8f49-ba62dc5a0472 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:00.372079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b64b-83d9-43bb-8f49-ba62dc5a0472 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:00.372079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b64b-83d9-43bb-8f49-ba62dc5a0472 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:00.374534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 594/1201] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:00.380737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:00.381259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:00.381350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:00.400564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:00.401900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:00.479785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 608/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:00.508136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6b64b-83d9-43bb-8f49-ba62dc5a0472 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:00.628824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6b64b-83d9-43bb-8f49-ba62dc5a0472 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:00.674196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:00.677439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:00.677439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:00.677439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:00.687135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:00.688608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:00.707190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:00.708580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 595/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:00.716453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:00.822794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830ef07-9894-41ba-9a8f-6265101a5396 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:00.861448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:00.862443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:00.862921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:00.863357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:00.864244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:00.864594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:00.868035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c718-9214-4f0d-8415-272153e7dcb9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:00.880444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 609/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:00.886891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:00.992065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0fe7-1588-4257-8f38-6a5de6f3ad38 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:01.031364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:01.032033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:01.032310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:01.032582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:01.033290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:01.034753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214a8b8-6f16-40bf-a218-62a5462027f0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:01.057995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 596/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Mar 20 16:08:00 2022] POST /identity/v3/users => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:08:03.600959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903cbc-3011-4f0f-be81-147454696a83 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:03.601524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903cbc-3011-4f0f-be81-147454696a83 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:03.601524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903cbc-3011-4f0f-be81-147454696a83 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:03.603290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 610/1206] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:03.608776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:03.609282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:03.609385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:03.628114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:03.629588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:03.702318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 597/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:03.728643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83903cbc-3011-4f0f-be81-147454696a83 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:03.840474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83903cbc-3011-4f0f-be81-147454696a83 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:03.886011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:03.886743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:03.888664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:03.888664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:03.899426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:03.907751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:08:03.909215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 611/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:08:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:08:03.915683 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.034733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133e61c-bc2b-4466-8350-08ee040aa6cc None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.071928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.072648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.072874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.073127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:04.074214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:04.074577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:04.075911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:04.089761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 598/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:04.091267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.212578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366204ee-5676-447b-8ba7-fa9c6d3b17dd None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.247700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.248515 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.248797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.249070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:04.261216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:04.262748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:04.284457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:04.291977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 612/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:04.292133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.398516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762723-8b52-4edc-9531-ef05fb7aed2f None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.438283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.438283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.438283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.438283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:04.438743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:04.438743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:04.438743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:04.449744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 599/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:04.456108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.586735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdb5a2-cc12-4782-a86e-71fc3f4b89a4 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.628405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.629294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.629594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.629928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:04.643438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:04.645068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:04.660865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:04.662280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 613/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:04.668344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.774030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789572-8aa6-49d7-9a00-3abc3839d8b7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.810392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.811752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.811752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.811752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:04.812421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:04.812763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:04.814166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:04.833604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 600/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:04.839057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:04.951437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c79c-07a2-4768-b250-a2b3cd89950b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:04.994897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:04.995912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:04.996414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:04.996691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:05.073855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:05.075522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:05.180981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 614/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:08:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:08:05.187054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:05.288020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bbf00-fba2-436b-9a6d-08084f6da23d None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:05.323498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:05.324299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:05.324574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:05.324842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:05.335255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:05.336691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:05.353873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:05.355248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 601/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:05.361264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:05.479600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e497dd-17a7-4d78-a399-78b16b71ca7e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:05.518387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:05.519215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:05.519584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:05.519940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:05.520751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:05.521144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:05.522673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:05.535235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 615/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:05.540901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:05.645462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882e9f0-1ef8-45bf-be7e-6d2939697b60 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:05.679383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:05.680305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:05.680581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:05.680874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:05.688710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:05.690231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:05.704286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:05.705783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 602/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:08:05.711660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:05.815659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d3d6-0851-4aa9-b9d8-1ead2c49d7b0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:05.848769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:05.849597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:05.849974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:05.850387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:05.851278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:05.851686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:05.853201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d982faa-356d-4a81-83c7-937e0da2c168 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:05.866122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 616/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:05.871948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:05.973110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cd95-bcfe-4507-b600-efde469eb21e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:06.011839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:06.012509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:06.012786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:06.013053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:06.013889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=54281300b2394a829de25d19bebde181) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:06.014192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:06.015721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5be3c-fed3-4ac2-86b6-a0e4bd8cabea None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:06.021711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 603/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:08:05 2022] GET /identity/v3/role_assignments?user.id=54281300b2394a829de25d19bebde181&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:08.286115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e1da-7ffa-4bec-9363-85fffc49753b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:08.286731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e1da-7ffa-4bec-9363-85fffc49753b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:08.286731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2e1da-7ffa-4bec-9363-85fffc49753b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:08.288476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 617/1220] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:08.293738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:08.294153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:08.294385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:08.311609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:08.312791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:08.377627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 604/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:08:08.400306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2e1da-7ffa-4bec-9363-85fffc49753b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:08.507746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2e1da-7ffa-4bec-9363-85fffc49753b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:08.542183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:08.543074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:08.543355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:08.543661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:08.554172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:08.561882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:08:08.563121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 618/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:08.569158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:08.671936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869acc9e-7f21-4ec5-87fb-1c117a7532f6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:08.704802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:08.705466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:08.705744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:08.706009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:08.706783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] RBAC: Adding query filter params (name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:08.707081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:08.708440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:08.716487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 605/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:08.723062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:08.824991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990598b-f6b1-4bc7-b71d-c8a57dcf4313 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:08.859566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:08.860474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:08.860756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:08.861035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:08.872818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:08.874453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:08.891652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:08.892940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 619/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:08:08.898845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.003151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03daf27-c58e-4340-b760-42562598b1aa None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.039575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.040280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.040567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.040840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.041601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:09.041907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.043398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.061203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 606/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:09.062762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.172871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a292bd-003b-41b9-8ca6-c739c82b3ddc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.208236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.209059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.209332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.209660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.217832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.219396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.233102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:09.234442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 620/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:09.240876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.347891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974152d7-6541-46a3-8d3f-53813c8dfa78 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.384223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.384993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.385294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.385565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.386454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:09.386754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.388252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.407768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 607/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:09.413691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.520227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e0d9-fb79-4a30-bc9d-30f2b972d0ae None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.553848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.554680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.554957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.555229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.565575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.567053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.583065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:09.584236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 621/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:09.590235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.684779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7711e-2597-48ff-8c94-589c01b9dbb0 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.717838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.718678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.718966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.719285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.720127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:09.720429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.722002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.734373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 608/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:09.740397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:09.843121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c285-6e75-43bf-b411-ffc618954e2f None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:09.877113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:09.877951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:09.878228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:09.878564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:09.885594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:09.887296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:09.902510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:09.903699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 622/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:09.911506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:10.022804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687730-7a81-4df1-8f87-d60dce01f713 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:10.057372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:10.058030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:10.058331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:10.058599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:10.059374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:10.059671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:10.061095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae6e9-810d-4101-8961-7d490954cd84 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:10.072769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 609/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:10.078945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:10.175959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321327a-1988-4f24-90e1-094074692d5d None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:10.210119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:10.211060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:10.211416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:10.211615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/54281300b2394a829de25d19bebde181/roles/6b9766b371294e31bf4c4adf6bcb466b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:10.226410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=54281300b2394a829de25d19bebde181, role_id=6b9766b371294e31bf4c4adf6bcb466b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:10.228051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056780ef-751c-45f5-87df-053fc2fe62a2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:10.245714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 623/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:08:10 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/54281300b2394a829de25d19bebde181/roles/6b9766b371294e31bf4c4adf6bcb466b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:08:12.534816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299db3-2535-4dd6-9145-16dfc1018af8 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:12.535396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299db3-2535-4dd6-9145-16dfc1018af8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:12.535396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299db3-2535-4dd6-9145-16dfc1018af8 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:12.537429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 610/1233] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:12.542437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:12.542906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:12.543042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:12.560031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:12.561193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:12.626550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 624/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 20 16:08:12.649947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299db3-2535-4dd6-9145-16dfc1018af8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:12.754051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299db3-2535-4dd6-9145-16dfc1018af8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:12.789007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:12.789743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:12.790011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:12.790298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:12.800680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:12.807707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 20 16:08:12.808936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 611/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Mar 20 16:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:12.815492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:12.915231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861c7df-a6fe-462a-b254-a35edf09312e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:12.949852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:12.950613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:12.950820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:12.951101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:12.951893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:12.952147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:12.953534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:12.961269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 625/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Mar 20 16:08:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:12.967404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:13.081297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844c00-e92b-436c-ad65-ffda2ce5359b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:13.113579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:13.114409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:13.114688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:13.114959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:13.126438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:13.127982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:13.144950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:13.146141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 612/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:13.152115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:13.264131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc26-957c-405b-a52f-b01b8e7b2d30 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:13.298460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:13.299124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:13.299417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:13.299687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:13.300463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:13.300766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:13.302129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:13.314759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 626/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:13.320811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:13.424495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda3b5-9ddf-48b1-a7e6-9a287166ffda None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:13.457358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:13.458267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:13.458551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:13.458865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:13.468987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:13.470620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:13.488373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:13.489696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 613/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:08:13.496204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:13.598827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310bb2-941d-419f-98ed-4d92e368db50 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:13.633535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:13.634352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:13.634643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:13.634945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:13.635930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:13.636236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:13.637664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:13.656892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 627/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:13.662788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:13.767784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ed95-23b2-43d0-b65e-e5fcadff5981 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:13.807516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:13.808467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:13.808886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:13.809287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:13.885821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:13.887439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:13.986792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 614/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:08:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:08:13.993845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:14.106845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10d9f-bd8e-4027-b8a6-f2236496b9a5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:14.142752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:14.143533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:14.143807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:14.144071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:14.154195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:14.155652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:14.173080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:14.174308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 628/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:14.182845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:14.289617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f678-765d-4f83-87d5-e15742a5b184 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:14.328441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:14.329091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:14.329365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:14.329615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:14.330361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:14.330659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:14.332057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:14.343237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 615/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:14.349214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:14.462491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663519dd-a648-4b58-9e92-719dee77dceb None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:14.495759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:14.496557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:14.496836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:14.497101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:14.503958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:14.505422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:14.519422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:14.521029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 629/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:14.526646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:14.631327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17370362-d05f-43b4-8752-eb8a92ee50e7 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:14.665189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:14.665949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:14.666110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:14.666410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:14.667265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:14.667573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:14.669006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f53e9-6498-4333-9103-5ee2fa48544e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:14.680914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 616/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:14.687162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:14.794119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b51d-67e7-4bd0-9aff-60b1ef92cb9a None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:14.829118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:14.829876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:14.830230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:14.830565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:14.831507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] RBAC: Adding query filter params (role.id=6b9766b371294e31bf4c4adf6bcb466b, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=54281300b2394a829de25d19bebde181) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:14.831904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:14.833536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89560ce5-90f2-4357-bf9f-43c63ea08268 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:14.840163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 630/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:08:14 2022] GET /identity/v3/role_assignments?user.id=54281300b2394a829de25d19bebde181&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=6b9766b371294e31bf4c4adf6bcb466b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:17.227844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfa31-c028-4849-ab18-60ee5bd16064 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:17.228400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfa31-c028-4849-ab18-60ee5bd16064 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:17.228569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfa31-c028-4849-ab18-60ee5bd16064 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:17.230398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 617/1247] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:17.236375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:17.236814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:17.236900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:17.256978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:17.258397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:17.331360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 631/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:17.357380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacfa31-c028-4849-ab18-60ee5bd16064 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:17.465046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacfa31-c028-4849-ab18-60ee5bd16064 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:17.500388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:17.501190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:17.501460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:17.501725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:17.515148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:17.526768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:08:17.528925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 618/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:17.535719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:17.639751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383f766-e30e-4565-9d00-db64ec62be33 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:17.674420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:17.675099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:17.675380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:17.675656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:17.676402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:17.676730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:17.678240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:17.686958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 632/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:17.692852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:17.799283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84031-029b-4633-a25d-1ea2a3ae606e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:17.836535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:17.837359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:17.837655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:17.837931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:17.850569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:17.852025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:17.868880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:17.870077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 619/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:17.876023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:17.985689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19633d-9cf9-41f7-815e-9c1d505e958e None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:18.031914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:18.032912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:18.033331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:18.033715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:18.034643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:18.035050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:18.036677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:18.052522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 633/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:18.058773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:18.164470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a31ac-a9b6-47b7-a579-021c4a678956 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:18.207673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:18.208742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:18.209091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:18.209401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:18.220029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:18.222034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:18.238594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:18.239915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 620/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:18.246625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:18.358094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9f2a-7216-4ce6-9891-79305ced663b None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:18.393331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:18.394078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:18.394355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:18.394694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:18.395532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:18.395887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:18.397467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:18.415662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 634/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:18.421943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:18.526678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef251-49b2-49af-90d6-d2156a559156 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:18.566777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:18.567470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:18.567784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:18.568084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:18.639887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:18.641291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:18.742966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 621/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:08:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 20 16:08:18.749316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:18.858756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213724b-3c0e-42b4-8ae7-9f53e26a4dde None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:18.894166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082122-133b-44f8-8529-f113632598b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:18.895025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082122-133b-44f8-8529-f113632598b3 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:18.895336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082122-133b-44f8-8529-f113632598b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:18.895681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082122-133b-44f8-8529-f113632598b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:18.907861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082122-133b-44f8-8529-f113632598b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:18.909613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082122-133b-44f8-8529-f113632598b3 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:18.928039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-19082122-133b-44f8-8529-f113632598b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:18.929211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 635/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 20 16:08:18.935309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:19.054434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5146-5371-4f00-bd48-19f8da8ebc40 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:19.091363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:19.092158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:19.092440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:19.092709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:19.093473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:19.093788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:19.095227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:19.108070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 622/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:19.114356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082122-133b-44f8-8529-f113632598b3 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:19.226534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082122-133b-44f8-8529-f113632598b3 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:19.263547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:19.264364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:19.264637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:19.264903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:19.272275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:19.273722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:19.287347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:19.288585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 636/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:19.294870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:19.395868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e347a6-12be-47cb-b6bb-74e494e368ea None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:19.428925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:19.429593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:19.429872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:19.430137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:19.430982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:19.431288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:19.432734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb985f-1766-410f-a180-2ab5165d023b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:19.446030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 623/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:19.454918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:19.555744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ced07-1535-48e7-b0b1-f3a16ec95351 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:19.587473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:19.588125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:19.588404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:19.588668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:19.589484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=54281300b2394a829de25d19bebde181) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:19.589787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:19.591262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efae12b-79a6-4b3e-bf4e-5447afbb4ad7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:19.596855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 637/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:08:19 2022] GET /identity/v3/role_assignments?user.id=54281300b2394a829de25d19bebde181&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:21.841304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbb7d-9033-4430-b237-30a4ccb62d2f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:21.841862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbb7d-9033-4430-b237-30a4ccb62d2f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:21.841862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbb7d-9033-4430-b237-30a4ccb62d2f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:21.843669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 624/1261] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:21.849894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:21.850686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:21.850841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:21.878723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:21.880563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:21.952318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 638/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:21.985784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbbb7d-9033-4430-b237-30a4ccb62d2f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.090858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbbb7d-9033-4430-b237-30a4ccb62d2f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.124869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.125589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.125861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.126131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.136625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:22.143522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:08:22.144705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 625/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:22.151001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.257984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98136f-49a6-4d83-b96f-80222ccf01cd None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.291543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.292193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.292468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.292740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.293482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:22.293787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:22.295182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:22.303098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 639/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:22.312281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.426341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90b66-85f9-418d-9c87-ff33997eb807 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.459429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.460197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.460474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.460739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.471961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:22.473389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:22.489453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:22.490886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 626/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:22.499430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.598983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a93dc-250c-4d98-90b8-29e620d03aa5 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.632557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.633201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.633481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.633750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.634492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:22.634799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:22.636149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:22.647651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 640/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:22.653599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.748411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e907db-750b-433b-bd0c-a5687fe5be01 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.781314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.782085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.782391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.782650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] PATH_INFO: `/v3/users/placement` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.790080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:22.791535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:22.805027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:22.806157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 627/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:22.811943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:22.927752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60449b-ad44-486a-a3cc-62503d06f931 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:22.961358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:22.962020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:22.962301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:22.962548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:22.963423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:22.963690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:22.965140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:22.991806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 641/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:23.002233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:23.097810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9151c-5ecd-4790-a51b-eb265655cafc None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:23.131363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:23.132129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:23.132401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:23.132672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:23.143265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:23.144694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:23.160738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:23.161860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 628/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:23.168276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:23.280184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e426b88-266c-4bb8-bd9c-e549bb698996 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:23.315862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:23.316519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:23.316799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:23.317073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:23.317786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:23.318093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:23.319503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:23.330615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 642/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:23.336740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:23.441816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cb710-aa96-423c-8333-0a54ccf986b2 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:23.475141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:23.475919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:23.476197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:23.476466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:23.483245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:23.484718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:23.498455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:23.499652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 629/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:23.506314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:23.615885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2eadd-ab9d-49da-a9fd-a05b0e45a6d9 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:23.657290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:23.657931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:23.658204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:23.658490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:23.659327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:23.659631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:23.661044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01f9c7-8d16-47d7-aa6b-ff37c589573d None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:23.673476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 643/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:23.679776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:23.780462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519109ec-f5ee-4486-8f03-e7b50df54f57 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:23.814181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:23.815081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:23.815358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:23.815629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] PATH_INFO: `/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/54281300b2394a829de25d19bebde181/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:23.817806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] RBAC: Authorizing `identity:create_grant(project_id=43d4d70875464df4a5eaf859e71356f1, user_id=54281300b2394a829de25d19bebde181, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:23.819264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce686ee-1e8c-437d-8f17-cbfa88a12119 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:23.838025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 630/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Mar 20 16:08:23 2022] PUT /identity/v3/projects/43d4d70875464df4a5eaf859e71356f1/users/54281300b2394a829de25d19bebde181/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:08:26.074566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63638-f86b-4dc3-8d8b-12a336ceaddf None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.075462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63638-f86b-4dc3-8d8b-12a336ceaddf None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.075462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63638-f86b-4dc3-8d8b-12a336ceaddf None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.078232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 644/1274] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:26.083515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.083963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.084055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.103046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:26.104185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:26.171606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 631/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:26.195278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63638-f86b-4dc3-8d8b-12a336ceaddf None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:26.297928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63638-f86b-4dc3-8d8b-12a336ceaddf None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:26.331738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:26.332467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.332741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.333001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.345471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 20 16:08:26.352286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 20 16:08:26.353442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 645/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Mar 20 16:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:26.359869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:26.462009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447b49-268d-4af6-a674-f31055b8ffe3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:26.498399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:26.499048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.499328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.499623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.500360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:26.500665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:26.502030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:26.510838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 632/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Mar 20 16:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:26.516723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:26.634587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1ce6-6dea-4b4e-b476-c0e0cdc6f8f2 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:26.669277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:26.670058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.670360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.670631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.681227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:26.682718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:26.698933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:26.700067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 646/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:26.709180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:26.809567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60673ce-daf1-492b-b702-54fd0fff705e None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:26.842814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:26.843504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:26.843775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:26.844043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:26.844758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:26.845053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:26.846433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:26.857730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 633/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:26.863562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:26.979521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35e21-6b02-4fd0-bd6b-94f0327d7512 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:27.021128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:27.022419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:27.022762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:27.023233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:27.033380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:27.035523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:27.052864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 20 16:08:27.054624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 647/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:27.064042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:27.168191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffa6ac-2532-4bdc-a231-c52a2ec593e1 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:27.201528 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:27.202187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:27.202483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:27.202804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:27.203620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:27.203916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:27.205340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:27.222434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 634/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Mar 20 16:08:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:27.228890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:27.344270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aea2d-3e7d-4d6a-8604-9ec1ae20fe34 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:27.378676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:27.379308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:27.379589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:27.379858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:27.443973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:27.445412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:27.540611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 648/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Mar 20 16:08:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 20 16:08:27.549627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:27.669432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f83f-9d08-4c6a-b209-4dc2b451ad6b None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:27.704847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:27.705632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:27.705912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:27.706181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:27.716320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:27.717766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:27.735445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 20 16:08:27.736570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 635/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:27.742992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:27.842508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0b6e-7c0f-479a-8681-3552ecf18ef0 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:27.875722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:27.876367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:27.876641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:27.876912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:27.877620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:27.877918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:27.879295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:27.890201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 649/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Mar 20 16:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:27.896350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:28.010646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159123-5ee8-4d11-84b8-0bd9146b841a None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:28.042980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:28.043789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:28.044069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:28.044337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:28.050869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:28.052329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:28.065014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING keystone.server.flask.application [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 20 16:08:28.066150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 636/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Mar 20 16:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:28.072204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:28.169093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd99ef-f5bd-4bcc-b1c7-bec6d2829036 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:28.204532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:28.205463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:28.205839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:28.206209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:28.207454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:28.208134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:28.209757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82637b1f-5492-4eda-ac19-42b0c20125f7 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:28.225383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 650/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Mar 20 16:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:28.231490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:28.332253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb54ea-884a-419e-84a5-567027fdabc6 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:28.366031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:28.366699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:28.366977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:28.367249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:28.368073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] RBAC: Adding query filter params (role.id=48d62f7e510942b2a76f34ddf04cd808, scope.project.id=43d4d70875464df4a5eaf859e71356f1, user.id=54281300b2394a829de25d19bebde181) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:28.368382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:28.369811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cef44-e098-40b5-96de-da85fab52c13 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:28.375616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 637/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Mar 20 16:08:28 2022] GET /identity/v3/role_assignments?user.id=54281300b2394a829de25d19bebde181&scope.project.id=43d4d70875464df4a5eaf859e71356f1&role.id=48d62f7e510942b2a76f34ddf04cd808 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:30.664134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095079-c3a9-462e-a1a4-11ffd2c759b5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:30.665004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095079-c3a9-462e-a1a4-11ffd2c759b5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:30.665004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095079-c3a9-462e-a1a4-11ffd2c759b5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:30.667891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 651/1288] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:30.673219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:30.673665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:30.673766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:30.690861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:30.692007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:30.756606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 638/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:30.778200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41095079-c3a9-462e-a1a4-11ffd2c759b5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:30.880435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41095079-c3a9-462e-a1a4-11ffd2c759b5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:30.913092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:30.913862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:30.914197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:30.914444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:30.915076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:30.916417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:30.927175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 20 16:08:30.928272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 652/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:08:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:30.937664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:31.051288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209a94-7e40-4bd2-b4c3-6b3ef4ba3126 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:31.084164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:31.084820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:31.085096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:31.085365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:31.086063 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:31.086398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:31.087755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041723cf-1200-484b-8319-10c15fbe6ce0 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:31.092384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 639/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Mar 20 16:08:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:31.098305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:31.194417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289bfd-73ff-4dbe-b40d-ec6e2a26b681 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:31.228788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:31.229441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:31.229710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:31.229977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] PATH_INFO: `/v3/services` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:31.230706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] RBAC: Adding query filter params (type=placement) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:31.231003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:31.232348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c58e-96bd-41e2-bf49-25218da81a1a None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:31.236768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 653/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Mar 20 16:08:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:33.478504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04aefc-58e2-42ee-b652-2460112a0e93 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:33.479028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04aefc-58e2-42ee-b652-2460112a0e93 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:33.479028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04aefc-58e2-42ee-b652-2460112a0e93 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:33.481790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 640/1293] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:33.490569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540635d-d322-474f-9ed5-84c506525184 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:33.491296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540635d-d322-474f-9ed5-84c506525184 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:33.491472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540635d-d322-474f-9ed5-84c506525184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:33.513662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1540635d-d322-474f-9ed5-84c506525184 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:33.514899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1540635d-d322-474f-9ed5-84c506525184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:33.583020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 654/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:33.611820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04aefc-58e2-42ee-b652-2460112a0e93 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:33.713245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04aefc-58e2-42ee-b652-2460112a0e93 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:33.747275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:33.747860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:33.748140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:33.748420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:33.749147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:33.750584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7a685-8018-4de0-95e5-293c218a3a14 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:33.766290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 641/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Mar 20 16:08:33 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:08:36.044971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8a9b-9b9c-4f3e-83a1-faf0d2da0cca None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.045546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8a9b-9b9c-4f3e-83a1-faf0d2da0cca None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.045546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8a9b-9b9c-4f3e-83a1-faf0d2da0cca None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.047370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 655/1296] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:36.052684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.053057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.053228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.070320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:36.071497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:36.148401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 642/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:36.171002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8a9b-9b9c-4f3e-83a1-faf0d2da0cca None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:36.285601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8a9b-9b9c-4f3e-83a1-faf0d2da0cca None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:36.319324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:36.320052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.320330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.320596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] PATH_INFO: `/v3/services/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.321260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:36.322677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:36.333889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 20 16:08:36.335051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 656/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:08:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:36.344022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:36.441856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602477d-bfe5-4b56-9e14-35dc45dcff61 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:36.476017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:36.476662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.476936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.477213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.477913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:36.478216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:36.479617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:36.484544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 643/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Mar 20 16:08:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:08:36.493799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:36.594099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5db3d-51db-49a3-b40b-d913a0888cdc None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:36.627503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:36.628133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.628410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.628681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.629451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] RBAC: Adding query filter params (interface=public, service_id=0bdca27e81b240b1bee9c13dd7d6b887, region_id=RegionOne) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:36.629754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:36.631132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38dfb1-da2a-4f65-9e40-2fc3366ace04 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:36.636077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 657/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Mar 20 16:08:36 2022] GET /identity/v3/endpoints?service_id=0bdca27e81b240b1bee9c13dd7d6b887&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:36.642153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:36.753847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6756-cb12-47e4-afde-ecda9cdc3a27 None admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:36.788778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:36.789415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:36.789690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:36.789960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:36.790664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:36.792008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa187da1-4657-44d7-9b58-61e1e3f7018e None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:36.798780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 644/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Mar 20 16:08:36 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:08:39.103365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d8d-2f63-4587-a52f-dae1707fd9a5 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:39.104224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d8d-2f63-4587-a52f-dae1707fd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:39.104224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039d8d-2f63-4587-a52f-dae1707fd9a5 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:39.107193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 658/1302] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:08:39.112644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:39.113066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:39.113178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:39.134413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:08:39.135595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:08:39.202486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 645/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:08:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 20 16:08:39.226047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039d8d-2f63-4587-a52f-dae1707fd9a5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:39.341013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039d8d-2f63-4587-a52f-dae1707fd9a5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:39.375336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:39.376053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:39.376330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:39.376598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:39.377240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:39.378635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:39.389863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING keystone.server.flask.application [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 20 16:08:39.391064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 659/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Mar 20 16:08:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 20 16:08:39.400342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:39.508635 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8b33-3f4b-4ab4-906d-a8d3a5a515cb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:39.546865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:39.547518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:39.547794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:39.548060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] PATH_INFO: `/v3/services` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:39.548767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] RBAC: Adding query filter params (name=placement) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:08:39.549071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:39.550468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b242dc-8dd6-414d-bce6-8376b3fbe3de None admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:39.556052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 646/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Mar 20 16:08:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:08:39.562299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:08:39.664379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac97e-9f5f-411e-9412-66218afb9854 None admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:08:39.698150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:08:39.698822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:08:39.699099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:08:39.699368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:08:39.700090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:08:39.701449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d71664-b4be-4977-a5a0-e9b9302eacd2 None admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:08:39.725445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 660/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Mar 20 16:08:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:09:43.451661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:43.452793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:43.453268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:43.459136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 647/1307] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:09:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:43.460476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358ff6-73d5-4bbb-bb92-fc859ef1cef9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:43.460909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358ff6-73d5-4bbb-bb92-fc859ef1cef9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:43.461120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358ff6-73d5-4bbb-bb92-fc859ef1cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:43.542507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1a358ff6-73d5-4bbb-bb92-fc859ef1cef9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:43.543713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1a358ff6-73d5-4bbb-bb92-fc859ef1cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:43.648898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 661/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:09:43.672802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:09:43.674652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:43.824480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45bf4a-3b08-4bc9-994a-d24e3bfb06bf None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:09:43.927294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:09:43.928368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:43.928879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:43.929386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:43.930343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:09:43.932457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:09:43.932457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:09:43.932457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:09:43.934064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a17c-7077-49af-8be7-6b9f610633e6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:09:43.952866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 648/1309] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:09:43 2022] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:09:46.263272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b583b-777f-4b1f-b185-18b0ba88b89a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:46.263883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b583b-777f-4b1f-b185-18b0ba88b89a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:46.263883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b583b-777f-4b1f-b185-18b0ba88b89a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:46.265603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 662/1310] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:46.271148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405bf4-934c-4757-a4ec-6a007f2b1075 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:46.271608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405bf4-934c-4757-a4ec-6a007f2b1075 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:46.271693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405bf4-934c-4757-a4ec-6a007f2b1075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:46.342646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-30405bf4-934c-4757-a4ec-6a007f2b1075 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:46.343936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-30405bf4-934c-4757-a4ec-6a007f2b1075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:46.439861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 649/1311] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:46.488989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:46.489236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:46.489815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:46.492009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 663/1312] 10.222.0.18 () {54 vars in 963 bytes} [Sun Mar 20 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:46.498444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27ce2-54bc-44ba-803b-dc520848ce4c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:46.498731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27ce2-54bc-44ba-803b-dc520848ce4c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:46.499004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27ce2-54bc-44ba-803b-dc520848ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:46.574612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c0a27ce2-54bc-44ba-803b-dc520848ce4c None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:46.576121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c0a27ce2-54bc-44ba-803b-dc520848ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:46.653325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 650/1313] 10.222.0.18 () {58 vars in 1060 bytes} [Sun Mar 20 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:46.662390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:09:46.663914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:46.772000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc180c6-1823-40fd-bc7c-65755ebdbf47 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:09:46.878521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:09:46.879304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:46.879676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:46.880011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:46.881845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:47.016160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:09:47.017608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbb794-f063-4b3e-89fb-9c02a496b2e1 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:09:47.035680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 664/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:09:49.609617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:49.610524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:49.610524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:49.613387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 651/1315] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:09:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:49.619928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7810-1b88-4074-8533-53df8961561f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:49.620362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7810-1b88-4074-8533-53df8961561f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:49.620491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7810-1b88-4074-8533-53df8961561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:49.692353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-470a7810-1b88-4074-8533-53df8961561f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:49.693436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-470a7810-1b88-4074-8533-53df8961561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:49.790694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 665/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:49.831899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:09:49.834404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:49.949151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be543-c320-4b14-b439-6ce66ef4bee6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:09:50.023486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:09:50.024125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:50.024401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:50.024674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:50.026304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:50.140817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:09:50.142242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc837b3-f58f-458a-a35c-c18cbada9234 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:09:50.159936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 652/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:09:52.729933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5011-2c65-4691-8ffd-69a2ea350b93 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:52.730876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5011-2c65-4691-8ffd-69a2ea350b93 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:52.730876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5011-2c65-4691-8ffd-69a2ea350b93 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:52.733820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 666/1318] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:09:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:52.740060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2e40-ecc5-4425-afa3-84d8d9f37743 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:52.740507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2e40-ecc5-4425-afa3-84d8d9f37743 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:52.740608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2e40-ecc5-4425-afa3-84d8d9f37743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:52.812817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-19ef2e40-ecc5-4425-afa3-84d8d9f37743 None None] MFA Rules not processed for user `8a9da56ceac14294a15bbd4a29f97677`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:52.813978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-19ef2e40-ecc5-4425-afa3-84d8d9f37743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:52.911935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 653/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:52.977466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:52.978038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:52.978451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:52.981357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 667/1320] 10.222.0.18 () {54 vars in 963 bytes} [Sun Mar 20 16:09:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:52.988096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a980-e433-4d93-b3f8-555c918b0e04 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:52.988493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a980-e433-4d93-b3f8-555c918b0e04 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:52.988892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a980-e433-4d93-b3f8-555c918b0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:53.069807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c135a980-e433-4d93-b3f8-555c918b0e04 None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:53.071043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c135a980-e433-4d93-b3f8-555c918b0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:53.147980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 654/1321] 10.222.0.18 () {58 vars in 1060 bytes} [Sun Mar 20 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:53.162055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:09:53.164346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:53.274045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934c912-dbe3-4eec-81fb-35742dc68837 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:09:53.348511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:09:53.349159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:53.349436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:53.349705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:53.351397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:53.462709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:09:53.464133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac26542-f7fc-4a95-a535-8ee6759133b9 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:09:53.482856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 668/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:09:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:09:56.665434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:56.666343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:56.666343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:56.669172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 655/1323] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:09:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:09:56.677954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c863-88da-4f9e-9b41-c0f90ec2733c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:56.678403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c863-88da-4f9e-9b41-c0f90ec2733c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:56.678570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c863-88da-4f9e-9b41-c0f90ec2733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:56.747624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3599c863-88da-4f9e-9b41-c0f90ec2733c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:09:56.748811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3599c863-88da-4f9e-9b41-c0f90ec2733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:56.854785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 669/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:09:56.904494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:09:56.906986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:57.018949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb98c8-b676-4f10-9303-3cb75d498017 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:09:57.092028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:09:57.092661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:09:57.092955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:09:57.093244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:09:57.094920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:09:57.213834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:09:57.215334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626218-2d50-40e6-a02f-67e02d66d59a service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:09:57.233489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 656/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:00.158409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:00.158971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:00.158971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:00.160739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 670/1326] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:00.166054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afada9-5c40-46c6-a09d-53f5a4dbe28c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:00.166538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afada9-5c40-46c6-a09d-53f5a4dbe28c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:00.166634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afada9-5c40-46c6-a09d-53f5a4dbe28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:00.232708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-33afada9-5c40-46c6-a09d-53f5a4dbe28c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:00.233974 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-33afada9-5c40-46c6-a09d-53f5a4dbe28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:00.332947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 657/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:00.369013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:00.370713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:00.473496 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3f76f-6150-4a9b-b5b4-2d5dfa5cd4a6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:00.546105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:00.546783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:00.547063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:00.547305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:00.548912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:00.654528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:00.655985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda706e9-d318-435a-be43-e016a569a9a0 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:00.673811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 671/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:02.983692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:02.984356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:02.984356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:02.986085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 658/1329] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:02.992100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1e909-8cd5-421d-8f72-8bf2209ba6d4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:02.992546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1e909-8cd5-421d-8f72-8bf2209ba6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:02.992649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1e909-8cd5-421d-8f72-8bf2209ba6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:03.057765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-39a1e909-8cd5-421d-8f72-8bf2209ba6d4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:03.058984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-39a1e909-8cd5-421d-8f72-8bf2209ba6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:03.155572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 672/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:03.190840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:03.192437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:03.297120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52f96d-0612-4435-9c18-a78faeaede12 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:03.369408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:03.370052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:03.370356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:03.370627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:03.372234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:03.481551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:03.483005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85472-b94e-405e-b570-404b9ddea642 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:03.502927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 659/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:05.802672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:05.803233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:05.803233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:05.804987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 673/1332] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:05.810323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8584c-bbe8-4f24-81ba-9dce73e61e5d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:05.810750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8584c-bbe8-4f24-81ba-9dce73e61e5d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:05.811013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8584c-bbe8-4f24-81ba-9dce73e61e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:05.875892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3bf8584c-bbe8-4f24-81ba-9dce73e61e5d None None] MFA Rules not processed for user `8a9da56ceac14294a15bbd4a29f97677`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:05.877078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3bf8584c-bbe8-4f24-81ba-9dce73e61e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:05.973304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 660/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:06.010420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:06.011938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:06.118489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805d1e6-c5d9-40d9-b7b0-1d3f3920ef88 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:06.191830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:06.192488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:06.192765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:06.193161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:06.194833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:06.304279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:06.305700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494f0df-5cff-4156-8539-55c6671e2781 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:06.324532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 674/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:10:08.817855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:08.818432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:08.818432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:08.820195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 661/1335] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:08.825414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51c53-8093-4022-8458-e29a600df54d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:08.825859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51c53-8093-4022-8458-e29a600df54d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:08.825963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51c53-8093-4022-8458-e29a600df54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:08.892874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c6b51c53-8093-4022-8458-e29a600df54d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:08.894083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c6b51c53-8093-4022-8458-e29a600df54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:08.999165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 675/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:09.038590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:09.040969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:09.151826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0026-acf1-4979-a81b-f62c2e4c8e93 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:09.227485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:09.228141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:09.228423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:09.228693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:09.230385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:09.337298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:09.338686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5e3e-31b4-4aef-b1e5-91efc5f24c7b service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:09.356366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 662/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:11.683949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:11.684487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:11.684487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:11.686315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 676/1338] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:11.692611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07ef5-2a50-4ddf-9fd7-ef110d9b7248 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:11.693342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07ef5-2a50-4ddf-9fd7-ef110d9b7248 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:11.693495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd07ef5-2a50-4ddf-9fd7-ef110d9b7248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:11.779838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6bd07ef5-2a50-4ddf-9fd7-ef110d9b7248 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:11.781124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6bd07ef5-2a50-4ddf-9fd7-ef110d9b7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:11.877506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 663/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:11.921219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:11.922779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:12.034796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14446447-026b-4abb-9661-aa98c91cd1f4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:12.117070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:12.117721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:12.117967 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:12.118236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:12.119886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:12.239151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:12.240590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8271c1b-9c52-4686-91d5-5694a15c8d51 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:12.259414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 677/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:15.025907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:15.026543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:15.026543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:15.028372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 664/1341] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:15.035985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d376c-5e7d-4874-b42b-9c03697c10f8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:15.036429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d376c-5e7d-4874-b42b-9c03697c10f8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:15.036530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d376c-5e7d-4874-b42b-9c03697c10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:15.106772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-794d376c-5e7d-4874-b42b-9c03697c10f8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:15.107950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-794d376c-5e7d-4874-b42b-9c03697c10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:15.211324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 678/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:10:15.251236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:15.254711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:15.357624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d1d-826f-4960-a3ff-6f0c3d6ab9e0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:15.362347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:15.363015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:15.363302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:15.363549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:15.373549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:15.375108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad611d-6e63-40dd-97ff-d8c6a2159613 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:15.384274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 665/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:19.619045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6071e-0b2e-4ed3-b035-8b6d7e5432ec None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:19.619621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6071e-0b2e-4ed3-b035-8b6d7e5432ec None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:19.619621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6071e-0b2e-4ed3-b035-8b6d7e5432ec None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:19.621273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 679/1344] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:19.626537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adf2-987b-4d51-829f-ad65ceb5635d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:19.626998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adf2-987b-4d51-829f-ad65ceb5635d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:19.627104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adf2-987b-4d51-829f-ad65ceb5635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:19.656446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7731adf2-987b-4d51-829f-ad65ceb5635d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:19.657629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7731adf2-987b-4d51-829f-ad65ceb5635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:19.734531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 666/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:19.773228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6071e-0b2e-4ed3-b035-8b6d7e5432ec None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:19.784924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6071e-0b2e-4ed3-b035-8b6d7e5432ec None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:19.788920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:19.789553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:19.789828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:19.790097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:19.799196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:19.800608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87219f-2407-4c66-8fe8-3f8324a2efad service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:19.809938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 680/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:22.627577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49b9e-6812-4308-bc16-4d09556aed53 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:22.628185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49b9e-6812-4308-bc16-4d09556aed53 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:22.628185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49b9e-6812-4308-bc16-4d09556aed53 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:22.629878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 667/1347] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:22.635150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3c23-6fe8-4ed8-8936-9eb1915e731d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:22.635596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3c23-6fe8-4ed8-8936-9eb1915e731d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:22.635690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3c23-6fe8-4ed8-8936-9eb1915e731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:22.654609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-df8b3c23-6fe8-4ed8-8936-9eb1915e731d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:22.655814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-df8b3c23-6fe8-4ed8-8936-9eb1915e731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:22.664377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 681/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:22.700913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49b9e-6812-4308-bc16-4d09556aed53 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:22.712305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49b9e-6812-4308-bc16-4d09556aed53 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:22.716106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:22.716726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:22.717001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:22.717269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:22.726347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:22.727755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3973c-3e75-43f3-8804-69d7a35be4bf service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:22.737023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 668/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:10:27.077286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c865-2a86-473f-be32-7cfe52d0cb12 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:27.077865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c865-2a86-473f-be32-7cfe52d0cb12 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:27.077865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c865-2a86-473f-be32-7cfe52d0cb12 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:27.079687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 682/1350] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:27.085218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43311d6-8a5f-46b4-9231-b0e7a68a9521 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:27.085646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43311d6-8a5f-46b4-9231-b0e7a68a9521 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:27.085753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43311d6-8a5f-46b4-9231-b0e7a68a9521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:27.104977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c43311d6-8a5f-46b4-9231-b0e7a68a9521 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:27.106177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c43311d6-8a5f-46b4-9231-b0e7a68a9521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:27.115756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 669/1351] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:27.153777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c865-2a86-473f-be32-7cfe52d0cb12 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:27.166197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c865-2a86-473f-be32-7cfe52d0cb12 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:27.170217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:27.170971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:27.171250 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:27.171517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:27.181319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:27.182698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325df3f6-02ef-49b3-9548-4ed5dddd603f service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:27.192173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 683/1352] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:32.338737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898124-44ec-4c76-9897-1457c757e973 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:32.339529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898124-44ec-4c76-9897-1457c757e973 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:32.340321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898124-44ec-4c76-9897-1457c757e973 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:32.342535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 670/1353] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:32.347958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048824-2857-4f9e-9c4b-529193adeea5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:32.348798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048824-2857-4f9e-9c4b-529193adeea5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:32.349210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048824-2857-4f9e-9c4b-529193adeea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:32.490029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-65048824-2857-4f9e-9c4b-529193adeea5 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:32.491492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-65048824-2857-4f9e-9c4b-529193adeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:32.569422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 684/1354] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:37.065478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06344e7-ea6f-4ec1-b499-69142ad23916 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:37.066072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06344e7-ea6f-4ec1-b499-69142ad23916 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:37.066072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06344e7-ea6f-4ec1-b499-69142ad23916 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:37.067968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 671/1355] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:37.072754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324a75-a3af-4ffa-83c5-caa48dd19e26 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:37.073555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324a75-a3af-4ffa-83c5-caa48dd19e26 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:37.074035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324a75-a3af-4ffa-83c5-caa48dd19e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:37.093856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f7324a75-a3af-4ffa-83c5-caa48dd19e26 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:37.095050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f7324a75-a3af-4ffa-83c5-caa48dd19e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:37.104222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 685/1356] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:38.562393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfb3b-0041-46a5-93ed-fa1723f73803 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:38.563042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfb3b-0041-46a5-93ed-fa1723f73803 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:38.563042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfb3b-0041-46a5-93ed-fa1723f73803 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:38.564687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 672/1357] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:38.569888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee99ba-eed7-46eb-aa74-7ff092a7949b None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:38.570374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee99ba-eed7-46eb-aa74-7ff092a7949b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:38.570469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee99ba-eed7-46eb-aa74-7ff092a7949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:38.590371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-00ee99ba-eed7-46eb-aa74-7ff092a7949b None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:38.591541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-00ee99ba-eed7-46eb-aa74-7ff092a7949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:38.600201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 686/1358] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:42.292204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cdeca-15ea-42cc-a958-e78417746696 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:42.292743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cdeca-15ea-42cc-a958-e78417746696 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:42.292743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cdeca-15ea-42cc-a958-e78417746696 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:42.294501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 673/1359] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:42.299848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537fbd-5e19-4928-bcaa-344c107f2876 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:42.300268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537fbd-5e19-4928-bcaa-344c107f2876 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:42.300579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537fbd-5e19-4928-bcaa-344c107f2876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:42.319663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-0d537fbd-5e19-4928-bcaa-344c107f2876 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:42.320964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0d537fbd-5e19-4928-bcaa-344c107f2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:42.330121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 687/1360] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:42.378613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fa-5fc9-4a3e-a87c-76e0f0cda01d None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:42.378971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fa-5fc9-4a3e-a87c-76e0f0cda01d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:42.379362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fa-5fc9-4a3e-a87c-76e0f0cda01d None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:42.381274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 674/1361] 10.222.0.18 () {54 vars in 959 bytes} [Sun Mar 20 16:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:42.386855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873f3e-555d-4940-811c-e0772129eae4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:42.387197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873f3e-555d-4940-811c-e0772129eae4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:42.387544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37873f3e-555d-4940-811c-e0772129eae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:42.439155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-37873f3e-555d-4940-811c-e0772129eae4 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:42.440531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-37873f3e-555d-4940-811c-e0772129eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:42.525595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 688/1362] 10.222.0.18 () {58 vars in 1056 bytes} [Sun Mar 20 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:42.534966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e27fa-5fc9-4a3e-a87c-76e0f0cda01d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:42.550400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e27fa-5fc9-4a3e-a87c-76e0f0cda01d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:42.556518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:42.557536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:42.557992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:42.558949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:42.570248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:42.572156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c09d-3e05-4cd8-8ad4-1a0ccef1c71b service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:42.595373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 675/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:10:45.063712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabdc00-3ab6-4802-bc88-2ead887c016f None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:45.064295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabdc00-3ab6-4802-bc88-2ead887c016f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:45.064295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabdc00-3ab6-4802-bc88-2ead887c016f None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:45.065992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 689/1364] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:45.071330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167fab0-48cb-481e-987e-25763a58f843 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:45.071756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167fab0-48cb-481e-987e-25763a58f843 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:45.071852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167fab0-48cb-481e-987e-25763a58f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:45.091197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2167fab0-48cb-481e-987e-25763a58f843 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:45.092402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2167fab0-48cb-481e-987e-25763a58f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:45.100742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 676/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:45.146492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabdc00-3ab6-4802-bc88-2ead887c016f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:45.164130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabdc00-3ab6-4802-bc88-2ead887c016f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:45.169931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:45.170820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:45.171278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:45.171726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:45.180387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:45.182165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d3ed8-4052-4819-a949-2d862c73126a service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:45.192047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 690/1366] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:47.809757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190836-0af4-4c9d-92d6-e1859a6653af None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:47.810402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190836-0af4-4c9d-92d6-e1859a6653af None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:47.810402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d190836-0af4-4c9d-92d6-e1859a6653af None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:47.812189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 677/1367] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:47.817747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62082dc-dcfd-4b7f-b317-7f43ea26b8fa None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:47.818177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62082dc-dcfd-4b7f-b317-7f43ea26b8fa None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:47.818320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62082dc-dcfd-4b7f-b317-7f43ea26b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:47.836659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a62082dc-dcfd-4b7f-b317-7f43ea26b8fa None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:47.837840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a62082dc-dcfd-4b7f-b317-7f43ea26b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:47.846925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 691/1368] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:47.894141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eaa3f-b7cc-446a-a1e9-53039fcef910 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:47.894141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eaa3f-b7cc-446a-a1e9-53039fcef910 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:47.894476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eaa3f-b7cc-446a-a1e9-53039fcef910 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:47.896466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 678/1369] 10.222.0.18 () {54 vars in 959 bytes} [Sun Mar 20 16:10:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:47.903565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec7dd-7aee-4023-b1b4-8e2f0e3073a9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:47.904411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec7dd-7aee-4023-b1b4-8e2f0e3073a9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:47.904894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ec7dd-7aee-4023-b1b4-8e2f0e3073a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:47.925937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d53ec7dd-7aee-4023-b1b4-8e2f0e3073a9 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:47.928004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d53ec7dd-7aee-4023-b1b4-8e2f0e3073a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:47.938313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 692/1370] 10.222.0.18 () {58 vars in 1056 bytes} [Sun Mar 20 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:47.946118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eaa3f-b7cc-446a-a1e9-53039fcef910 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:47.962081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eaa3f-b7cc-446a-a1e9-53039fcef910 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:47.967536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:47.968361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:47.968640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:47.968907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:47.977829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:47.979625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca9735-1d4b-4513-997b-a447cebd2130 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:47.990641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 679/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:50.313183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c995-bc01-49a7-b879-55b407dc172a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.313757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c995-bc01-49a7-b879-55b407dc172a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.313757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c995-bc01-49a7-b879-55b407dc172a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.315728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 693/1372] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:50.320150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75907-9adc-4d42-8fda-6c32ef5c0ad2 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.320586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75907-9adc-4d42-8fda-6c32ef5c0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.320697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75907-9adc-4d42-8fda-6c32ef5c0ad2 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.320830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.321073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.321351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.322766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 680/1373] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:50.328207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cd0f-0c22-498d-bf3f-4d8f37e2e6e2 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.328490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cd0f-0c22-498d-bf3f-4d8f37e2e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.329878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cd0f-0c22-498d-bf3f-4d8f37e2e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.340091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:50.341346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:50.348163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-49a1cd0f-0c22-498d-bf3f-4d8f37e2e6e2 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:50.349487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-49a1cd0f-0c22-498d-bf3f-4d8f37e2e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:50.350319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 694/1374] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:50.361365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 681/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:10:50.394966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:50.407453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a3f3-b372-4812-97a0-603154bdd5a0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:50.413072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:50.413931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.414336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.414803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.423220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:50.424928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f90a55-72c5-4331-9aab-343eababadc4 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:50.434827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 695/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:50.663415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9a02-3bc8-4143-85fe-79d95054158a None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.663849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9a02-3bc8-4143-85fe-79d95054158a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.664222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c9a02-3bc8-4143-85fe-79d95054158a None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.666389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 682/1377] 10.222.0.18 () {54 vars in 962 bytes} [Sun Mar 20 16:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:10:50.671538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eefae9-15a8-441e-8233-eb7929117e70 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.671987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eefae9-15a8-441e-8233-eb7929117e70 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.672367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eefae9-15a8-441e-8233-eb7929117e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.720861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e5eefae9-15a8-441e-8233-eb7929117e70 None None] MFA Rules not processed for user `e4d9cf83f9e241549009f2e8b56e5767`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:50.722103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e5eefae9-15a8-441e-8233-eb7929117e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:50.779261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 696/1378] 10.222.0.18 () {58 vars in 1059 bytes} [Sun Mar 20 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:50.788039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c9a02-3bc8-4143-85fe-79d95054158a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:50.799046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c9a02-3bc8-4143-85fe-79d95054158a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:50.802775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:50.803415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:50.803694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:50.803965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:50.813253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:50.814753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f5cd-2c2b-4db2-95a9-75a2c5032b53 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:50.825512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 683/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:10:52.772259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaae25-6ae7-4075-8a19-f7b737d22bbc None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:52.772795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaae25-6ae7-4075-8a19-f7b737d22bbc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:52.772795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaae25-6ae7-4075-8a19-f7b737d22bbc None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:52.774528 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 697/1380] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:52.779943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa03cb-8b29-4476-86d7-47334736215c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:52.780391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa03cb-8b29-4476-86d7-47334736215c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:52.780501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa03cb-8b29-4476-86d7-47334736215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:52.799236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-07fa03cb-8b29-4476-86d7-47334736215c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:52.800431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-07fa03cb-8b29-4476-86d7-47334736215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:52.808915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 684/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:52.852105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaae25-6ae7-4075-8a19-f7b737d22bbc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:52.866212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaae25-6ae7-4075-8a19-f7b737d22bbc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:52.871965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:52.872659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:52.872943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:52.873218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:52.881437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:52.883048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a415e-ad98-4757-b3df-9b052557bc68 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:52.892536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 698/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:55.195455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792640-a447-49ba-be58-63b49d46a1a9 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:55.196053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792640-a447-49ba-be58-63b49d46a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:55.196053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792640-a447-49ba-be58-63b49d46a1a9 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:55.197703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 685/1383] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:55.203000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8dea5-c433-490a-baa3-8c06b696170f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:55.203742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8dea5-c433-490a-baa3-8c06b696170f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:55.204180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8dea5-c433-490a-baa3-8c06b696170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:55.226052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-68b8dea5-c433-490a-baa3-8c06b696170f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:55.227252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-68b8dea5-c433-490a-baa3-8c06b696170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:55.235256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 699/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:55.278296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792640-a447-49ba-be58-63b49d46a1a9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:55.293160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792640-a447-49ba-be58-63b49d46a1a9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:55.298613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:55.299232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:55.299505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:55.299779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:55.307692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:55.309241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b58a4-1422-4d4d-b4f3-48ebf8db47ed service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:55.318496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 686/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:10:57.630984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd78-51f9-4e2a-a2b3-3a7b04e4cf7c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:57.631522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd78-51f9-4e2a-a2b3-3a7b04e4cf7c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:57.631522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd78-51f9-4e2a-a2b3-3a7b04e4cf7c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:57.633270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 700/1386] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:10:57.638405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ab85-69cf-48ab-b048-62134f4706fc None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:57.638827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ab85-69cf-48ab-b048-62134f4706fc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:57.639010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ab85-69cf-48ab-b048-62134f4706fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:57.656762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ef91ab85-69cf-48ab-b048-62134f4706fc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:10:57.657944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ef91ab85-69cf-48ab-b048-62134f4706fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:10:57.666330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 687/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:10:57.707380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febd78-51f9-4e2a-a2b3-3a7b04e4cf7c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:10:57.724027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febd78-51f9-4e2a-a2b3-3a7b04e4cf7c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:10:57.730919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:10:57.731691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:10:57.732074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:10:57.732583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:10:57.741552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:10:57.743582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b9c5c-6e00-4596-9437-6c4258029184 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:10:57.755686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 701/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:00.297432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee8a2-4282-46a4-b61e-6bb8dcd6f3e5 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:00.298115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee8a2-4282-46a4-b61e-6bb8dcd6f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:00.298115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee8a2-4282-46a4-b61e-6bb8dcd6f3e5 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:00.300118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 688/1389] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:00.306742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d3bf-33a3-4cf3-9bd3-16c50c38c126 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:00.307270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d3bf-33a3-4cf3-9bd3-16c50c38c126 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:00.307441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d3bf-33a3-4cf3-9bd3-16c50c38c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:00.326336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-8817d3bf-33a3-4cf3-9bd3-16c50c38c126 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:00.327533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8817d3bf-33a3-4cf3-9bd3-16c50c38c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:00.336328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 702/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:11:00.382303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ee8a2-4282-46a4-b61e-6bb8dcd6f3e5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:00.400848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ee8a2-4282-46a4-b61e-6bb8dcd6f3e5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:00.408275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:00.409124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:00.409467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:00.409816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:00.420432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:00.422030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86d64e-b356-495c-94f4-21be8038a8ed service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:00.431837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 689/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:02.794134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785450c-d031-4330-bf57-034ce53c0236 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:02.794749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785450c-d031-4330-bf57-034ce53c0236 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:02.795001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785450c-d031-4330-bf57-034ce53c0236 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:02.797802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 703/1392] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:02.803347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170a914-59b9-4b69-9f58-9ec78172b858 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:02.804004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170a914-59b9-4b69-9f58-9ec78172b858 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:02.804004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170a914-59b9-4b69-9f58-9ec78172b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:02.823375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2170a914-59b9-4b69-9f58-9ec78172b858 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:02.824660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2170a914-59b9-4b69-9f58-9ec78172b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:02.833753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 690/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:02.893911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785450c-d031-4330-bf57-034ce53c0236 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:02.916111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785450c-d031-4330-bf57-034ce53c0236 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:02.924453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:02.925448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:02.925824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:02.926242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:02.938991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:02.941428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1f4d0-a89a-4cb3-9b7a-8d2e6cbb9f61 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:02.956346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 704/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:05.291105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903acd-a04f-4d35-ba96-72270ca0db05 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:05.291681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903acd-a04f-4d35-ba96-72270ca0db05 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:05.291681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903acd-a04f-4d35-ba96-72270ca0db05 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:05.293423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 691/1395] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:05.298660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52286883-c82a-4fe6-9be8-f4a9d93ce525 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:05.299112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52286883-c82a-4fe6-9be8-f4a9d93ce525 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:05.299219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52286883-c82a-4fe6-9be8-f4a9d93ce525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:05.316990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-52286883-c82a-4fe6-9be8-f4a9d93ce525 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:05.318308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-52286883-c82a-4fe6-9be8-f4a9d93ce525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:05.325940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 705/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:05.370180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52903acd-a04f-4d35-ba96-72270ca0db05 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:05.386359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52903acd-a04f-4d35-ba96-72270ca0db05 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:05.392805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:05.393449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:05.393734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:05.394012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:05.403003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:05.404659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7708a8-2f7a-43c1-a006-bef2c0e6d2fb service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:05.415523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 692/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:06.568721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7fa4d-538d-4439-929e-c30b56bbc945 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:06.569352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7fa4d-538d-4439-929e-c30b56bbc945 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:06.569464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7fa4d-538d-4439-929e-c30b56bbc945 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:06.571231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 706/1398] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:06.576655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba1d-d576-4cff-b83a-f14cb8276840 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:06.577078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba1d-d576-4cff-b83a-f14cb8276840 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:06.577250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ba1d-d576-4cff-b83a-f14cb8276840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:06.595722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-91e6ba1d-d576-4cff-b83a-f14cb8276840 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:06.596917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-91e6ba1d-d576-4cff-b83a-f14cb8276840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:06.608123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 693/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:06.666123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0400-cf93-4c1f-aabf-e06705443894 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:06.666512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0400-cf93-4c1f-aabf-e06705443894 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:06.666854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0400-cf93-4c1f-aabf-e06705443894 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:06.668794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 707/1400] 10.222.0.18 () {54 vars in 961 bytes} [Sun Mar 20 16:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:06.673750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503dfa-2971-4648-8012-0b9dc9a833e5 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:06.674157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503dfa-2971-4648-8012-0b9dc9a833e5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:06.674466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503dfa-2971-4648-8012-0b9dc9a833e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:06.721724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-09503dfa-2971-4648-8012-0b9dc9a833e5 None None] MFA Rules not processed for user `ee72038f64224b14bad9e63568c3e316`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:06.722957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-09503dfa-2971-4648-8012-0b9dc9a833e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:06.782358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 694/1401] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Mar 20 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:06.789829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0400-cf93-4c1f-aabf-e06705443894 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:06.800897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0400-cf93-4c1f-aabf-e06705443894 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:06.804558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:06.805192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:06.805489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:06.805760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:06.814814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:06.816213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49266525-f99b-405a-ba7f-06b8687fc1de service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:06.825643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 708/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:07.243554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757045-9688-4297-8405-30a3b7295d07 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.243842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757045-9688-4297-8405-30a3b7295d07 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.244117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99757045-9688-4297-8405-30a3b7295d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.291995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-99757045-9688-4297-8405-30a3b7295d07 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:07.293187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-99757045-9688-4297-8405-30a3b7295d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:07.358005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 695/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:07.406401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abee8b-c77e-4d6e-941d-cc522d224578 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.406686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abee8b-c77e-4d6e-941d-cc522d224578 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.406953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abee8b-c77e-4d6e-941d-cc522d224578 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.408766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 709/1404] 10.222.0.18 () {54 vars in 942 bytes} [Sun Mar 20 16:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:07.415189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0e4b-5b15-4cea-9aab-80941900eccf None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.415478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0e4b-5b15-4cea-9aab-80941900eccf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.415750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0e4b-5b15-4cea-9aab-80941900eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.466068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-951d0e4b-5b15-4cea-9aab-80941900eccf None None] MFA Rules not processed for user `c8dbf02e3130431c9bc3a95a97e039c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:07.467305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-951d0e4b-5b15-4cea-9aab-80941900eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:07.537607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 696/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Sun Mar 20 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:07.547103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abee8b-c77e-4d6e-941d-cc522d224578 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:07.560951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abee8b-c77e-4d6e-941d-cc522d224578 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:07.566136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:07.566884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.567223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.567553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.576147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:07.577826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615479c-77c7-40c1-95f8-15fb4373707a service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:07.585696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 710/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:11:07.725516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb67a5-6604-4b17-acce-7a3e19aa64eb None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.726061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb67a5-6604-4b17-acce-7a3e19aa64eb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.726061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb67a5-6604-4b17-acce-7a3e19aa64eb None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.728159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 697/1407] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:07.733397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a25a2-fa7a-4669-b248-b003d333da7a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.733797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a25a2-fa7a-4669-b248-b003d333da7a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.734076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a25a2-fa7a-4669-b248-b003d333da7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.752873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c03a25a2-fa7a-4669-b248-b003d333da7a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:07.754362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c03a25a2-fa7a-4669-b248-b003d333da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:07.762387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 711/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:11:07.805402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb67a5-6604-4b17-acce-7a3e19aa64eb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:07.820040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb67a5-6604-4b17-acce-7a3e19aa64eb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:07.825964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:07.826661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:07.826942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:07.828979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:07.836646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:07.838329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21398400-4268-489c-81d2-6bc927eb385a service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:07.848615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 698/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:10.197458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90b51e-544a-413c-a4db-d5e48792fefb None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:10.198008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90b51e-544a-413c-a4db-d5e48792fefb None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:10.198602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90b51e-544a-413c-a4db-d5e48792fefb None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:10.200440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 712/1410] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:10.207925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7bd9b-92ec-4437-9715-8f42f2042569 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:10.208286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7bd9b-92ec-4437-9715-8f42f2042569 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:10.208286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7bd9b-92ec-4437-9715-8f42f2042569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:10.240059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5db7bd9b-92ec-4437-9715-8f42f2042569 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:10.241363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5db7bd9b-92ec-4437-9715-8f42f2042569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:10.254831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 699/1411] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:10.294987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90b51e-544a-413c-a4db-d5e48792fefb None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:10.313186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90b51e-544a-413c-a4db-d5e48792fefb None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:10.320341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:10.321065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:10.325565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:10.325884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:10.335803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:10.337420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c29874-d745-438d-af3f-5ab2cbbae425 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:10.349011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 713/1412] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:30.630663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d951e9-4580-4913-b9f4-5d516ced5568 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:30.631334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d951e9-4580-4913-b9f4-5d516ced5568 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:30.631334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d951e9-4580-4913-b9f4-5d516ced5568 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:30.633035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 700/1413] 10.222.0.18 () {54 vars in 918 bytes} [Sun Mar 20 16:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:30.638591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0849-31d5-447d-9a5b-d65ee9f49ba1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:30.639080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0849-31d5-447d-9a5b-d65ee9f49ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:30.639182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0849-31d5-447d-9a5b-d65ee9f49ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:30.658072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7d0c0849-31d5-447d-9a5b-d65ee9f49ba1 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:30.659307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7d0c0849-31d5-447d-9a5b-d65ee9f49ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:30.669404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 714/1414] 10.222.0.18 () {58 vars in 1015 bytes} [Sun Mar 20 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:30.684033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c9fd-fdf2-4a22-90ae-a1912be9941c None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:30.684283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c9fd-fdf2-4a22-90ae-a1912be9941c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:30.684583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c9fd-fdf2-4a22-90ae-a1912be9941c None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:30.686369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 701/1415] 10.222.0.18 () {54 vars in 918 bytes} [Sun Mar 20 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:30.691267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500d1ca-fed8-42a6-b01b-0511322cd2c5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:30.691550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500d1ca-fed8-42a6-b01b-0511322cd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:30.691827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500d1ca-fed8-42a6-b01b-0511322cd2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:30.710139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d500d1ca-fed8-42a6-b01b-0511322cd2c5 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:30.711332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d500d1ca-fed8-42a6-b01b-0511322cd2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:30.721021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 715/1416] 10.222.0.18 () {58 vars in 1015 bytes} [Sun Mar 20 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:33.429544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad764a-5eee-4dde-a06f-a094f358d58f None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:33.430488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad764a-5eee-4dde-a06f-a094f358d58f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:33.430488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad764a-5eee-4dde-a06f-a094f358d58f None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:33.433240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:33.439559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f033-6ade-47be-9c36-4c145044140c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:33.440035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f033-6ade-47be-9c36-4c145044140c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:33.440132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f033-6ade-47be-9c36-4c145044140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:33.459189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5d09f033-6ade-47be-9c36-4c145044140c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:33.460282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5d09f033-6ade-47be-9c36-4c145044140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:33.468901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:11:33.510026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad764a-5eee-4dde-a06f-a094f358d58f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:33.532956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad764a-5eee-4dde-a06f-a094f358d58f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:33.540285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:33.540918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:33.541197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:33.541468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:33.550066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:33.551679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b850c-f5fb-4188-86f9-92ab32393d23 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:33.561296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 703/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:34.905420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d171dc-1c5b-4f32-b05b-da7d15518b4a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:34.906403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d171dc-1c5b-4f32-b05b-da7d15518b4a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:34.906403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d171dc-1c5b-4f32-b05b-da7d15518b4a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:34.909177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:34.917428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda9c8-d36b-489c-81c8-6e4c3e5bb638 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:34.917865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda9c8-d36b-489c-81c8-6e4c3e5bb638 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:34.917976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda9c8-d36b-489c-81c8-6e4c3e5bb638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:34.939577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e5fda9c8-d36b-489c-81c8-6e4c3e5bb638 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:34.940803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e5fda9c8-d36b-489c-81c8-6e4c3e5bb638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:34.950851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:35.126839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d171dc-1c5b-4f32-b05b-da7d15518b4a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:35.145313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d171dc-1c5b-4f32-b05b-da7d15518b4a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:35.151945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:35.152572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:35.152848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:35.153166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:35.161317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:35.162862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5f36-eb1e-48d4-be04-2c282c806d5e service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:35.171943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 718/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:36.455462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4f30-fa07-464f-906a-422b64492ed5 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:36.456346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4f30-fa07-464f-906a-422b64492ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:36.456346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4f30-fa07-464f-906a-422b64492ed5 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:36.459306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:36.467290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e218d2-7bf9-4990-b640-7efbc8fb08a1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:36.467746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e218d2-7bf9-4990-b640-7efbc8fb08a1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:36.467847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e218d2-7bf9-4990-b640-7efbc8fb08a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:36.487303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-47e218d2-7bf9-4990-b640-7efbc8fb08a1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:36.488500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-47e218d2-7bf9-4990-b640-7efbc8fb08a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:36.499039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:36.650439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4f30-fa07-464f-906a-422b64492ed5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:36.673625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4f30-fa07-464f-906a-422b64492ed5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:36.679489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:36.680124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:36.680403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:36.680676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:36.688854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:36.690475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212fa9-390e-4539-9d33-9072e36674aa service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:36.699805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 706/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:37.991041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834721-a215-46d8-b411-5e04bf7e178a None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:37.991639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834721-a215-46d8-b411-5e04bf7e178a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:37.991639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834721-a215-46d8-b411-5e04bf7e178a None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:37.994722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:38.002356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403484b-8dca-4066-a643-87ba2a18b85f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:38.002765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403484b-8dca-4066-a643-87ba2a18b85f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:38.002966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403484b-8dca-4066-a643-87ba2a18b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:38.031121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b403484b-8dca-4066-a643-87ba2a18b85f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:38.032356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b403484b-8dca-4066-a643-87ba2a18b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:38.041597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:38.190691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46834721-a215-46d8-b411-5e04bf7e178a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:38.207830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46834721-a215-46d8-b411-5e04bf7e178a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:38.213979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:38.214681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:38.214959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:38.215227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:38.224129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:38.225724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9278b9-a6e5-457d-b893-295b0718e2d6 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:38.235613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 721/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:39.507788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eda3f-af38-4f34-a91e-72bc3b0874b7 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:39.508294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eda3f-af38-4f34-a91e-72bc3b0874b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:39.508294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eda3f-af38-4f34-a91e-72bc3b0874b7 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:39.510090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:39.515197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b1617-1106-4cd5-9822-dbf2fca701c1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:39.515645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b1617-1106-4cd5-9822-dbf2fca701c1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:39.515741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b1617-1106-4cd5-9822-dbf2fca701c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:39.534238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-819b1617-1106-4cd5-9822-dbf2fca701c1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:39.535458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-819b1617-1106-4cd5-9822-dbf2fca701c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:39.544049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:39.703370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eda3f-af38-4f34-a91e-72bc3b0874b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:39.727907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eda3f-af38-4f34-a91e-72bc3b0874b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:39.736946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:39.737585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:39.737849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:39.738135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:39.747253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:39.748839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11154f-33b0-4e33-ab7e-b52d17b610ca service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:39.758417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 709/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:40.986596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d6b-c4fa-4a64-bf5f-036f93589ccb None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:40.987423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d6b-c4fa-4a64-bf5f-036f93589ccb None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:40.987423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d6b-c4fa-4a64-bf5f-036f93589ccb None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:40.990807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:40.997333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e9e6-5a00-4df0-abec-e6c6d73bc5bd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:40.997839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e9e6-5a00-4df0-abec-e6c6d73bc5bd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:40.997946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e9e6-5a00-4df0-abec-e6c6d73bc5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:41.025014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-cb08e9e6-5a00-4df0-abec-e6c6d73bc5bd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:41.026770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-cb08e9e6-5a00-4df0-abec-e6c6d73bc5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:41.037064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:41.186482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52d6b-c4fa-4a64-bf5f-036f93589ccb None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:41.202020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52d6b-c4fa-4a64-bf5f-036f93589ccb None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:41.208816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:41.209559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:41.209845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:41.210119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:41.219884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:41.221574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba176892-9c09-4738-9177-f10bde9f3283 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:41.232894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 724/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:42.471261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66c95-8c3b-4a97-862e-18aa66d2b4b0 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:42.472187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66c95-8c3b-4a97-862e-18aa66d2b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:42.472187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66c95-8c3b-4a97-862e-18aa66d2b4b0 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:42.475162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:42.483832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c89b-1b8b-43b0-807c-3915c4ff780f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:42.484285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c89b-1b8b-43b0-807c-3915c4ff780f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:42.484389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c89b-1b8b-43b0-807c-3915c4ff780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:42.508054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-78f8c89b-1b8b-43b0-807c-3915c4ff780f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:42.509281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-78f8c89b-1b8b-43b0-807c-3915c4ff780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:42.517615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:42.672634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66c95-8c3b-4a97-862e-18aa66d2b4b0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:42.689523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66c95-8c3b-4a97-862e-18aa66d2b4b0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:42.695240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:42.695869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:42.696162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:42.696428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:42.706791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:42.708484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21ca7-1575-4697-8961-a54d19d9789f service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:42.718584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 712/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:43.947640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345da0-e33d-4104-927a-43a0d311aeab None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:43.948290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345da0-e33d-4104-927a-43a0d311aeab None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:43.948290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345da0-e33d-4104-927a-43a0d311aeab None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:43.949989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:43.956248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7730a-f3d4-46a1-adaa-9a46f31662e6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:43.956911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7730a-f3d4-46a1-adaa-9a46f31662e6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:43.957067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7730a-f3d4-46a1-adaa-9a46f31662e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:43.984925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f9e7730a-f3d4-46a1-adaa-9a46f31662e6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:43.986767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f9e7730a-f3d4-46a1-adaa-9a46f31662e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:44.000264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:44.153679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345da0-e33d-4104-927a-43a0d311aeab None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:44.175941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345da0-e33d-4104-927a-43a0d311aeab None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:44.182473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:44.183102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:44.183383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:44.183652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:44.191911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:44.193522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d2161-15d8-4bff-a74a-72d5b55d4956 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:44.203429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 727/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:45.465977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb928-7966-416b-8b19-f18098f4d563 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:45.466829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb928-7966-416b-8b19-f18098f4d563 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:45.466829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb928-7966-416b-8b19-f18098f4d563 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:45.468555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:11:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:45.473861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e20f-e170-4bd6-9250-f0c020aae030 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:45.474344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e20f-e170-4bd6-9250-f0c020aae030 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:45.474671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e20f-e170-4bd6-9250-f0c020aae030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:45.493929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f387e20f-e170-4bd6-9250-f0c020aae030 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:45.495151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f387e20f-e170-4bd6-9250-f0c020aae030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:45.504004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:45.656947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beb928-7966-416b-8b19-f18098f4d563 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:45.677911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beb928-7966-416b-8b19-f18098f4d563 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:45.684361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:45.684991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:45.685294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:45.685569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:45.693807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:45.695420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4282257-2bd9-4c1e-a894-a53c2f88d598 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:45.705555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 715/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:47.841759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:47.842349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:47.842349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:47.844098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:47.849523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a284-59e7-4559-b833-0bc61afb622d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:47.849987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a284-59e7-4559-b833-0bc61afb622d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:47.850085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a284-59e7-4559-b833-0bc61afb622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:47.869393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-06e5a284-59e7-4559-b833-0bc61afb622d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:47.870621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-06e5a284-59e7-4559-b833-0bc61afb622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:47.879981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:47.919961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:47.921705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:47.935488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17ae75-f556-4ad3-b15a-c3bc58e4c03c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:47.939391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:47.940023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:47.940298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:47.940574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:47.949851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:47.951339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484398d4-0a5e-4a9a-be83-70af6fdc10dc service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:47.960616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 730/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:50.389481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66445-db59-4b5b-b74b-620d2c5aafcb None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:50.390098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66445-db59-4b5b-b74b-620d2c5aafcb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:50.390098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66445-db59-4b5b-b74b-620d2c5aafcb None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:50.391841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:50.397615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42983f-47f2-41e7-a156-9e40900ac38f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:50.398104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42983f-47f2-41e7-a156-9e40900ac38f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:50.398247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42983f-47f2-41e7-a156-9e40900ac38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:50.416900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9d42983f-47f2-41e7-a156-9e40900ac38f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:50.418127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9d42983f-47f2-41e7-a156-9e40900ac38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:50.427030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:50.464762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66445-db59-4b5b-b74b-620d2c5aafcb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:50.475600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66445-db59-4b5b-b74b-620d2c5aafcb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:50.479239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:50.479875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:50.480154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:50.480427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:50.489369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:50.490847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c214d5-f2f3-4e06-a34c-8e50800413a3 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:50.500494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 718/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:53.126481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162168-3949-4684-bbc7-0391e29f0902 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:53.127138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162168-3949-4684-bbc7-0391e29f0902 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:53.127138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162168-3949-4684-bbc7-0391e29f0902 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:53.128760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:53.135380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8977d-ec67-41b5-87ef-65a2d7eb2ec9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:53.136117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8977d-ec67-41b5-87ef-65a2d7eb2ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:53.136290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8977d-ec67-41b5-87ef-65a2d7eb2ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:53.155179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d9d8977d-ec67-41b5-87ef-65a2d7eb2ec9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:53.156358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d9d8977d-ec67-41b5-87ef-65a2d7eb2ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:53.164988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:53.203509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162168-3949-4684-bbc7-0391e29f0902 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:53.215591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162168-3949-4684-bbc7-0391e29f0902 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:53.219747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:53.220385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:53.220666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:53.220937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:53.230659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:53.232141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d107-babd-4390-aee2-a51e05ccadaf service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:53.241462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 733/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:11:55.616299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140430-fad5-43b7-a538-6df9c926bcbe None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:55.617168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140430-fad5-43b7-a538-6df9c926bcbe None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:55.617168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140430-fad5-43b7-a538-6df9c926bcbe None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:55.620064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:55.625540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd72bf-0808-44fa-a757-ef419a96841d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:55.626006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd72bf-0808-44fa-a757-ef419a96841d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:55.626111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd72bf-0808-44fa-a757-ef419a96841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:55.646202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a3cd72bf-0808-44fa-a757-ef419a96841d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:55.647471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a3cd72bf-0808-44fa-a757-ef419a96841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:55.656266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:55.694169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140430-fad5-43b7-a538-6df9c926bcbe None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:55.708639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140430-fad5-43b7-a538-6df9c926bcbe None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:55.715224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:55.716172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:55.716442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:55.716739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:55.731057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:55.732697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadbd11-b239-4260-a8a0-319fcbed3ac4 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:55.741957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 721/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:11:58.159345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea614f6-822b-49af-b3db-7cb4f05af24f None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:58.159941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea614f6-822b-49af-b3db-7cb4f05af24f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:58.159941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea614f6-822b-49af-b3db-7cb4f05af24f None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:58.161669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:11:58.167930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acefb-85d6-4634-924f-155f320d81a4 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:58.168378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acefb-85d6-4634-924f-155f320d81a4 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:58.168494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acefb-85d6-4634-924f-155f320d81a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:58.192214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-282acefb-85d6-4634-924f-155f320d81a4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:11:58.193496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-282acefb-85d6-4634-924f-155f320d81a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:11:58.202433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:11:58.240852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea614f6-822b-49af-b3db-7cb4f05af24f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:11:58.253134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea614f6-822b-49af-b3db-7cb4f05af24f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:11:58.257262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:11:58.257896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:11:58.258172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:11:58.258476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:11:58.268216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:11:58.269686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379063a-e666-4f43-abba-146c3b5ea530 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:11:58.279226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 736/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:00.640889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387714-baba-458b-a574-fa7477ba169c None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:00.641845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387714-baba-458b-a574-fa7477ba169c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:00.641997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e387714-baba-458b-a574-fa7477ba169c None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:00.644906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:12:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:00.651279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b015-06c8-4999-82d6-67223a84a21b None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:00.651771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b015-06c8-4999-82d6-67223a84a21b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:00.651892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b015-06c8-4999-82d6-67223a84a21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:00.677248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-8915b015-06c8-4999-82d6-67223a84a21b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:00.678462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8915b015-06c8-4999-82d6-67223a84a21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:00.687645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:00.725406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e387714-baba-458b-a574-fa7477ba169c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:00.737328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e387714-baba-458b-a574-fa7477ba169c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:00.741860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:00.742533 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:00.743186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:00.743466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:00.753703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:00.755172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800f5b-e0d1-4e16-a502-bdd990067b7d service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:00.765044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 724/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:03.066633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63520-47c6-4a46-aa86-b76d7a38a245 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:03.067214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63520-47c6-4a46-aa86-b76d7a38a245 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:03.067214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63520-47c6-4a46-aa86-b76d7a38a245 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:03.068971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:03.075523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a3db-22c2-45cb-90c6-40d1c21130a6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:03.075966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a3db-22c2-45cb-90c6-40d1c21130a6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:03.076106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a3db-22c2-45cb-90c6-40d1c21130a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:03.093988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-74c0a3db-22c2-45cb-90c6-40d1c21130a6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:03.095197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-74c0a3db-22c2-45cb-90c6-40d1c21130a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:03.107515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:03.144676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d63520-47c6-4a46-aa86-b76d7a38a245 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:03.162874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d63520-47c6-4a46-aa86-b76d7a38a245 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:03.169893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:03.170553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:03.170829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:03.171097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:03.181093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:03.182549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb33c-5e4e-43b2-abd8-7e53c5304f5d service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:03.192380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 739/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:05.515750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-62b3-420e-a1e7-71631733a842 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:05.516276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-62b3-420e-a1e7-71631733a842 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:05.516383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b333-62b3-420e-a1e7-71631733a842 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:05.518096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:05.523449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d163b9-4729-45a9-a428-b953752babbf None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:05.523917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d163b9-4729-45a9-a428-b953752babbf None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:05.524027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d163b9-4729-45a9-a428-b953752babbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:05.541553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-38d163b9-4729-45a9-a428-b953752babbf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:05.542781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-38d163b9-4729-45a9-a428-b953752babbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:05.550740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:05.587815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b333-62b3-420e-a1e7-71631733a842 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:05.600816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b333-62b3-420e-a1e7-71631733a842 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:05.605381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:05.606007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:05.606297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:05.606589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:05.616526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:05.618290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c5060-ffc0-47ae-bb6b-2f78a718fded service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:05.627742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 727/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:07.931514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb16e4-8c80-497a-b265-30e834bfd5e1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:07.932114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb16e4-8c80-497a-b265-30e834bfd5e1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:07.932114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb16e4-8c80-497a-b265-30e834bfd5e1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:07.933831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:07.940322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7428a0-1770-4e3b-8cfb-6adfe4d5e61b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:07.940775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7428a0-1770-4e3b-8cfb-6adfe4d5e61b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:07.940868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7428a0-1770-4e3b-8cfb-6adfe4d5e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:07.968485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2d7428a0-1770-4e3b-8cfb-6adfe4d5e61b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:07.969672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2d7428a0-1770-4e3b-8cfb-6adfe4d5e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:07.977648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:08.017634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb16e4-8c80-497a-b265-30e834bfd5e1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:08.033899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb16e4-8c80-497a-b265-30e834bfd5e1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:08.038646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:08.039285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:08.039567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:08.039840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:08.048963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:08.050421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5512-3c3d-46cd-bfab-9cc38dbc9784 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:08.060907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 742/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:10.332410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34ccd-9622-43ed-b566-30a46531f496 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:10.333232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34ccd-9622-43ed-b566-30a46531f496 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:10.333232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34ccd-9622-43ed-b566-30a46531f496 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:10.336139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 729/1471] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:12:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:10.343724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05d7b2-b420-4033-8ba2-ccfd1adc6589 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:10.344147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05d7b2-b420-4033-8ba2-ccfd1adc6589 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:10.344274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05d7b2-b420-4033-8ba2-ccfd1adc6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:10.363235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-cc05d7b2-b420-4033-8ba2-ccfd1adc6589 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:10.364433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cc05d7b2-b420-4033-8ba2-ccfd1adc6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:10.374326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 743/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:10.410768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34ccd-9622-43ed-b566-30a46531f496 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:10.423280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34ccd-9622-43ed-b566-30a46531f496 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:10.427302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:10.427991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:10.428268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:10.428546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:10.437762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:10.439206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3892-fa6f-4a75-88f6-ff172b208a3d service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:10.448451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 730/1473] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:30.676333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca5846-a6cf-4889-bb17-ecba658a659b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:30.677306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca5846-a6cf-4889-bb17-ecba658a659b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:30.677306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca5846-a6cf-4889-bb17-ecba658a659b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:30.680036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 744/1474] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:30.688543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59619-6a7c-42e7-a3e5-fbbcdad4876e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:30.688991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59619-6a7c-42e7-a3e5-fbbcdad4876e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:30.689118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59619-6a7c-42e7-a3e5-fbbcdad4876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:30.711557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-47c59619-6a7c-42e7-a3e5-fbbcdad4876e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:30.712760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-47c59619-6a7c-42e7-a3e5-fbbcdad4876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:30.721625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 731/1475] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:30.772628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56581-2db0-4d37-a280-8acca3879df1 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:30.772908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56581-2db0-4d37-a280-8acca3879df1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:30.773207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56581-2db0-4d37-a280-8acca3879df1 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:30.775001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 745/1476] 10.222.0.18 () {54 vars in 961 bytes} [Sun Mar 20 16:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:30.779839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a135d-5a0e-4fad-ba02-675cf52b5e4d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:30.780122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a135d-5a0e-4fad-ba02-675cf52b5e4d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:30.780392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a135d-5a0e-4fad-ba02-675cf52b5e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:30.799341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-298a135d-5a0e-4fad-ba02-675cf52b5e4d None None] MFA Rules not processed for user `ee72038f64224b14bad9e63568c3e316`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:30.800504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-298a135d-5a0e-4fad-ba02-675cf52b5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:30.807243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 732/1477] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Mar 20 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:30.814290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56581-2db0-4d37-a280-8acca3879df1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:30.826450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56581-2db0-4d37-a280-8acca3879df1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:30.830458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:30.831081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:30.831358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:30.831626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:30.840728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:30.842131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf67f81-7f90-40f7-b60f-f7791e84b944 service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:30.851500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 746/1478] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:33.202738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679abd-403e-4874-9dbc-bbd19e5f09fe None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:33.203348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679abd-403e-4874-9dbc-bbd19e5f09fe None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:33.203348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679abd-403e-4874-9dbc-bbd19e5f09fe None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:33.205102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 733/1479] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:33.212691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8200b-07c6-4e7a-95ec-f5375a87710e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:33.213150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8200b-07c6-4e7a-95ec-f5375a87710e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:33.213261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8200b-07c6-4e7a-95ec-f5375a87710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:33.236932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-17e8200b-07c6-4e7a-95ec-f5375a87710e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:33.238113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-17e8200b-07c6-4e7a-95ec-f5375a87710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:33.247569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 747/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:33.270902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3679abd-403e-4874-9dbc-bbd19e5f09fe None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:33.285423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3679abd-403e-4874-9dbc-bbd19e5f09fe None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:33.291215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:33.291854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:33.292118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:33.292403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:33.293153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:33.295093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3560126-57b3-4835-af9b-b400b18f368a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:33.308612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 734/1481] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Mar 20 16:12:33 2022] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:12:35.582467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbccb-bcbc-4286-815d-72df36ae9e2e None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:35.583346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbccb-bcbc-4286-815d-72df36ae9e2e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:35.583346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbccb-bcbc-4286-815d-72df36ae9e2e None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:35.586484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 748/1482] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:35.592217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640dab7-84d7-493e-a707-84ccc4bc259a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:35.592676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640dab7-84d7-493e-a707-84ccc4bc259a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:35.592779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640dab7-84d7-493e-a707-84ccc4bc259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:35.610945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d640dab7-84d7-493e-a707-84ccc4bc259a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:35.612134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d640dab7-84d7-493e-a707-84ccc4bc259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:35.621109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 735/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:35.675113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dbccb-bcbc-4286-815d-72df36ae9e2e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:35.694275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dbccb-bcbc-4286-815d-72df36ae9e2e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:35.700035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:35.700669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:35.700947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:35.701219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:35.709598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:35.711255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cb95a-a490-42e1-a359-e44f48a605a3 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:35.720964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 749/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:38.134272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ba77-6a70-4809-b4a3-f68a957547b4 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:38.134896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ba77-6a70-4809-b4a3-f68a957547b4 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:38.134896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ba77-6a70-4809-b4a3-f68a957547b4 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:38.136606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 736/1485] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:38.142014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a489b-8edb-490e-afc2-bbece570abc6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:38.142481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a489b-8edb-490e-afc2-bbece570abc6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:38.142598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a489b-8edb-490e-afc2-bbece570abc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:38.161663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-955a489b-8edb-490e-afc2-bbece570abc6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:38.162866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-955a489b-8edb-490e-afc2-bbece570abc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:38.173119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 750/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:38.208445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ba77-6a70-4809-b4a3-f68a957547b4 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:38.221252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ba77-6a70-4809-b4a3-f68a957547b4 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:38.225638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:38.226618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:38.226967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:38.227312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:38.238157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:38.239642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6755b-bf3e-4595-944e-0ec5113bb623 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:38.249359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 737/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:40.532126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779834b-4c41-4520-a99d-ba151f69a497 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:40.533023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779834b-4c41-4520-a99d-ba151f69a497 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:40.533023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779834b-4c41-4520-a99d-ba151f69a497 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:40.536001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 751/1488] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:40.542194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0259-58fd-44c3-b2f2-8289d7084ca6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:40.542657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0259-58fd-44c3-b2f2-8289d7084ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:40.542829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0259-58fd-44c3-b2f2-8289d7084ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:40.562025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-574a0259-58fd-44c3-b2f2-8289d7084ca6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:40.563287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-574a0259-58fd-44c3-b2f2-8289d7084ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:40.572210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 738/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:40.609763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779834b-4c41-4520-a99d-ba151f69a497 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:40.623000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779834b-4c41-4520-a99d-ba151f69a497 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:40.627588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:40.628248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:40.628523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:40.628777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:40.638311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:40.639744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aed0b2-9400-43cd-b607-cf6fcb68c3ef service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:40.649075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 752/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:43.057369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0112-3172-4085-86a4-d6c9187a2921 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:43.057959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0112-3172-4085-86a4-d6c9187a2921 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:43.057959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0112-3172-4085-86a4-d6c9187a2921 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:43.060365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 739/1491] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:43.065889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5623f1-55d1-4801-8f11-a392076a1848 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:43.066404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5623f1-55d1-4801-8f11-a392076a1848 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:43.066519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5623f1-55d1-4801-8f11-a392076a1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:43.084398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7d5623f1-55d1-4801-8f11-a392076a1848 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:43.085570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7d5623f1-55d1-4801-8f11-a392076a1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:43.094004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 753/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:12:43.137685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0112-3172-4085-86a4-d6c9187a2921 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:43.154882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0112-3172-4085-86a4-d6c9187a2921 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:43.159413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:43.160039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:43.160316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:43.160576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:43.170133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:43.171576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40a44-ea30-4019-ac51-fc3191b6faaa service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:43.180776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 740/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:12:45.619661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500f82-fdff-4b7b-9816-2cbb48ebda63 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:45.620223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500f82-fdff-4b7b-9816-2cbb48ebda63 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:45.620223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500f82-fdff-4b7b-9816-2cbb48ebda63 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:45.622667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 754/1494] 10.222.0.18 () {54 vars in 926 bytes} [Sun Mar 20 16:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:12:45.629232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a50-ddb2-4870-8532-da6f538f7ebd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:45.629661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a50-ddb2-4870-8532-da6f538f7ebd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:45.629800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a50-ddb2-4870-8532-da6f538f7ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:45.650330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-abbf5a50-ddb2-4870-8532-da6f538f7ebd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:12:45.651531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-abbf5a50-ddb2-4870-8532-da6f538f7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:12:45.660897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 741/1495] 10.222.0.18 () {58 vars in 1023 bytes} [Sun Mar 20 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:12:45.702276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e500f82-fdff-4b7b-9816-2cbb48ebda63 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:12:45.719329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e500f82-fdff-4b7b-9816-2cbb48ebda63 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:12:45.726119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:12:45.727090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:12:45.727489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:12:45.727828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:12:45.738594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:12:45.740023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5045-add4-4b85-8aa7-dda5844ac209 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:12:45.750186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 755/1496] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:14:11.552557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.552980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.552980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.573448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:14:11.574656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:11.583505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 742/1497] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:14:11.593664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.594210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.594210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.622488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:14:11.623679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:11.633023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 756/1498] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:14:11.637667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.647551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e261c3-5f6d-48e1-b869-3615a09c334c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.653243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.653887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.654160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.654460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.655175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:14:11.655475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.656494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.656494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:14:11.656494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:14:11.657358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.668998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 743/1499] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:14:11.676897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.686310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ccd29-bde4-49dd-8bf9-5b5ef910b487 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.692110 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.692759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.693092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.693365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.694045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.695857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.695857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:14:11.695857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:14:11.697045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.740980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 757/1500] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:14:11 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:14:11.746346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.756885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f79ef-d623-4a79-9f91-9b3dff559574 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.815255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.816150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.816584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.817010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.818096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.819727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.819727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:14:11.819727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:14:11.821650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.850526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 744/1501] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:14:11 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:14:11.851792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.861822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94248de-f0bb-4589-b58c-c19dc3c16721 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.866789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.867441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.867723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.868000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.868726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.870067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.870067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:14:11.870067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:14:11.871063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.883976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 758/1502] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:14:11.888148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.904627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b2d03-613f-40b8-917e-af2b769593d6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.913579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.914573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.914939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.915296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.916376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.917909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.917909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:14:11.917909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:14:11.918815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371d4a6-ac87-4def-b55b-80940ec187ab admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.932374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 745/1503] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:14:11.936837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:11.947101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb52a-58dc-4d3c-83cb-3cb544921c3b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:11.952689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:11.953560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.953836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.954106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] PATH_INFO: `/v3/projects/51be8b3d531e4b5492af69d3eae2bffd/users/bedaf3920c55403fa70c6c146cc74fdb/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:11.969321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51be8b3d531e4b5492af69d3eae2bffd, user_id=bedaf3920c55403fa70c6c146cc74fdb, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:11.970350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:11.970350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:14:11.970350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:14:11.972276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:11.987495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 759/1504] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:14:11 2022] PUT /identity/v3/projects/51be8b3d531e4b5492af69d3eae2bffd/users/bedaf3920c55403fa70c6c146cc74fdb/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:14:11.999331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e894-8342-4c8a-ad66-48b0ec8872d5 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:11.999621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e894-8342-4c8a-ad66-48b0ec8872d5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:11.999900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e894-8342-4c8a-ad66-48b0ec8872d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.027066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9015e894-8342-4c8a-ad66-48b0ec8872d5 None None] MFA Rules not processed for user `bedaf3920c55403fa70c6c146cc74fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:14:12.028306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9015e894-8342-4c8a-ad66-48b0ec8872d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:12.100067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 746/1505] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:14:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:14:12.111832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:12.192808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f8af-45be-497a-a2d5-441079a416d9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:12.199542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:12.200158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:12.200433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:12.200703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.209179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:12.211694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:12.224704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 760/1506] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:14:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:14:12.298397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69636b-e188-46a6-ae67-a41c1da14d9b None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:12.298696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69636b-e188-46a6-ae67-a41c1da14d9b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:12.298965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69636b-e188-46a6-ae67-a41c1da14d9b None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.300660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 747/1507] 10.222.0.18 () {52 vars in 829 bytes} [Sun Mar 20 16:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:14:12.304469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:12.370059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552ae0b-0cda-4d99-96b4-355dca4243a3 service nova] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:12.375173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:12.376044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:12.376320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:12.376586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] PATH_INFO: `/v3/users/bedaf3920c55403fa70c6c146cc74fdb` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.377822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedaf3920c55403fa70c6c146cc74fdb)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:12.378876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:12.378876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:14:12.378876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:14:12.380075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:12.448883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedaf3920c55403fa70c6c146cc74fdb'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:12.458853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedaf3920c55403fa70c6c146cc74fdb'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:12.459506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedaf3920c55403fa70c6c146cc74fdb'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:12.460244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedaf3920c55403fa70c6c146cc74fdb'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:12.477558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedaf3920c55403fa70c6c146cc74fdb'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:12.495467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 761/1508] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:14:12 2022] DELETE /identity/v3/users/bedaf3920c55403fa70c6c146cc74fdb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:14:12.500513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b392b6-818d-4827-9629-ef40df330067 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:12.500791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b392b6-818d-4827-9629-ef40df330067 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:12.501059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b392b6-818d-4827-9629-ef40df330067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.519031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-73b392b6-818d-4827-9629-ef40df330067 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:14:12.520208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-73b392b6-818d-4827-9629-ef40df330067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:12.579563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 748/1509] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:14:12.590145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:12.591849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:12.650620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c732df-8486-4634-9de5-22aa46c5da36 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:12.654233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:12.654988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:12.655269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:12.655572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:12.664711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:12.666136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ec37-fb29-4d0a-b880-f3cb2b62f879 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:12.675412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 762/1510] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:14:12.992540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b392b6-818d-4827-9629-ef40df330067 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:14:12.994426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-73b392b6-818d-4827-9629-ef40df330067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:14:13.007814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b392b6-818d-4827-9629-ef40df330067 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:14:13.014771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:14:13.015648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:14:13.015936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:14:13.016230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] PATH_INFO: `/v3/projects/51be8b3d531e4b5492af69d3eae2bffd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:14:13.017436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51be8b3d531e4b5492af69d3eae2bffd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:14:13.019239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:14:13.019239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:14:13.019239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:14:13.020592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:14:13.084211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51be8b3d531e4b5492af69d3eae2bffd', 'request_id': 'req-70a4e777-4a26-4cb5-84f2-ca4f39d20923'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:13.097450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51be8b3d531e4b5492af69d3eae2bffd', 'request_id': 'req-70a4e777-4a26-4cb5-84f2-ca4f39d20923'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:13.104414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51be8b3d531e4b5492af69d3eae2bffd', 'request_id': 'req-70a4e777-4a26-4cb5-84f2-ca4f39d20923'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:13.122670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] The token cache is being invalidate because project 51be8b3d531e4b5492af69d3eae2bffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:14:13.122949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:13.124984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-70a4e777-4a26-4cb5-84f2-ca4f39d20923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:14:13.126658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 749/1511] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:14:12 2022] DELETE /identity/v3/projects/51be8b3d531e4b5492af69d3eae2bffd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:15:46.763441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfce3-5b77-407d-8b94-8e22e2f62c4f None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:46.764084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfce3-5b77-407d-8b94-8e22e2f62c4f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:46.764084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfce3-5b77-407d-8b94-8e22e2f62c4f None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:46.765787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 763/1512] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:15:46.770842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6600d9-fe4e-4bd3-b9c1-30e906eacfdd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:46.771289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6600d9-fe4e-4bd3-b9c1-30e906eacfdd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:46.771400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6600d9-fe4e-4bd3-b9c1-30e906eacfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:46.797195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-aa6600d9-fe4e-4bd3-b9c1-30e906eacfdd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:15:46.798587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-aa6600d9-fe4e-4bd3-b9c1-30e906eacfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:15:46.864032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 750/1513] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:15:46.874429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:46.874429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:46.874429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] PATH_INFO: `/v3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:46.875067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 764/1514] 10.222.0.42 () {54 vars in 925 bytes} [Sun Mar 20 16:15:46 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:15:46.881295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91876-0a69-482b-93b1-9d5c0efba381 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:46.881663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91876-0a69-482b-93b1-9d5c0efba381 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:46.881938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91876-0a69-482b-93b1-9d5c0efba381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:46.900715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-01f91876-0a69-482b-93b1-9d5c0efba381 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:15:46.901910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-01f91876-0a69-482b-93b1-9d5c0efba381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:15:46.964467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 751/1515] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Mar 20 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:15:47.016470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:15:47.018334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:15:47.103798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5abc5-c77d-45fc-907d-365884261e49 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:15:47.110467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:15:47.111120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:47.111406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:47.111662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:47.120468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:15:47.122062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6ce9-dd86-43d1-bd41-b0bf0ee22efb service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:15:47.131516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 765/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:15:48.389101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040409-e19f-4fab-a0cf-4001435fdc6b None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:48.389996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040409-e19f-4fab-a0cf-4001435fdc6b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:48.389996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040409-e19f-4fab-a0cf-4001435fdc6b None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:48.392785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 752/1517] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:15:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:15:48.400927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf94035-d505-403a-b455-9e96759eae19 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:48.401351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf94035-d505-403a-b455-9e96759eae19 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:48.401471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf94035-d505-403a-b455-9e96759eae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:48.419863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1bf94035-d505-403a-b455-9e96759eae19 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:15:48.421042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1bf94035-d505-403a-b455-9e96759eae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:15:48.429415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 766/1518] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:15:48.579500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b040409-e19f-4fab-a0cf-4001435fdc6b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:15:48.595913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b040409-e19f-4fab-a0cf-4001435fdc6b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:15:48.602441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:15:48.603097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:48.603379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:48.603654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:48.612725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:15:48.614338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5757-9d39-466c-ae9c-a0b9b94fcd7a service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:15:48.624203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 753/1519] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:15:55.908200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff90b2-718d-46ad-afbb-5d955a112b07 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:55.908774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff90b2-718d-46ad-afbb-5d955a112b07 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:55.908774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff90b2-718d-46ad-afbb-5d955a112b07 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:55.910553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 767/1520] 10.222.0.18 () {54 vars in 960 bytes} [Sun Mar 20 16:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:15:55.916721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88bd8d-9782-46a7-8f3e-28c43dfb9f60 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:55.917469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88bd8d-9782-46a7-8f3e-28c43dfb9f60 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:55.917625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88bd8d-9782-46a7-8f3e-28c43dfb9f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:55.944479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7e88bd8d-9782-46a7-8f3e-28c43dfb9f60 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:15:55.945654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7e88bd8d-9782-46a7-8f3e-28c43dfb9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:15:55.955350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 754/1521] 10.222.0.18 () {58 vars in 1057 bytes} [Sun Mar 20 16:15:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:15:55.962711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff90b2-718d-46ad-afbb-5d955a112b07 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:15:55.977735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff90b2-718d-46ad-afbb-5d955a112b07 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:15:55.983941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:15:55.984563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:15:55.984838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:15:55.985108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:15:55.993123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:15:55.994743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f1a69-240b-42f6-83c5-8e0d06cf9610 service placement] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:15:56.004846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 768/1522] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:00.310878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cf7a-384d-47d2-b264-973340c23761 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:00.311913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cf7a-384d-47d2-b264-973340c23761 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:00.311913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cf7a-384d-47d2-b264-973340c23761 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:00.314516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:16:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:00.321866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2d67-481a-4145-a7af-5c1fae19de33 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:00.322322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2d67-481a-4145-a7af-5c1fae19de33 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:00.322482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2d67-481a-4145-a7af-5c1fae19de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:00.342681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-615a2d67-481a-4145-a7af-5c1fae19de33 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:00.343871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-615a2d67-481a-4145-a7af-5c1fae19de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:00.353309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:00.510001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212cf7a-384d-47d2-b264-973340c23761 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:00.525852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212cf7a-384d-47d2-b264-973340c23761 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:00.531855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:00.532519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:00.532800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:00.533074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:00.541346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:00.542972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102728cc-04f0-4629-b57c-cbee3f9e7d3f service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:00.552670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 756/1525] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:01.798631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345757f0-1b01-40e8-8d15-171a14a261e3 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:01.799235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345757f0-1b01-40e8-8d15-171a14a261e3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:01.799235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345757f0-1b01-40e8-8d15-171a14a261e3 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:01.801066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 901 bytes} [Sun Mar 20 16:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:01.806391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d48af-a647-4f88-a1db-21d18319968b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:01.806841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d48af-a647-4f88-a1db-21d18319968b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:01.806950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d48af-a647-4f88-a1db-21d18319968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:01.825717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-923d48af-a647-4f88-a1db-21d18319968b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:01.826904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-923d48af-a647-4f88-a1db-21d18319968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:01.835527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 998 bytes} [Sun Mar 20 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:01.988464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345757f0-1b01-40e8-8d15-171a14a261e3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:02.009551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345757f0-1b01-40e8-8d15-171a14a261e3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:02.016197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:02.016939 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:02.017220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:02.017497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:02.026100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:02.027802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bc9b7-9d4f-4f42-b149-6a2f37af26f5 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:02.040029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 771/1528] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:06.087849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:06.088754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:06.088754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:06.091602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:16:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:06.096988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de24a4-063c-4060-b182-e3d8a0c10d96 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:06.097437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de24a4-063c-4060-b182-e3d8a0c10d96 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:06.097553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de24a4-063c-4060-b182-e3d8a0c10d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:06.117333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e2de24a4-063c-4060-b182-e3d8a0c10d96 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:06.118519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e2de24a4-063c-4060-b182-e3d8a0c10d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:06.128076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:06.163268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:06.165282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:06.234949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced3134-67fb-4ed7-8189-c71424dfd105 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:06.239591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:06.240239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:06.240517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:06.240785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:06.251207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:06.252642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c028628-2359-49ab-be77-82fe693e3e77 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:06.262553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 759/1531] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:08.504336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8aaef-04bd-4555-8047-a542e977117b None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:08.504870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8aaef-04bd-4555-8047-a542e977117b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:08.504870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8aaef-04bd-4555-8047-a542e977117b None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:08.507618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:08.516284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d220-cc96-4466-8f4b-6794cf576873 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:08.516790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d220-cc96-4466-8f4b-6794cf576873 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:08.516934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d220-cc96-4466-8f4b-6794cf576873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:08.536114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-90a3d220-cc96-4466-8f4b-6794cf576873 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:08.537307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-90a3d220-cc96-4466-8f4b-6794cf576873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:08.546159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:08.581634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8aaef-04bd-4555-8047-a542e977117b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:08.594914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8aaef-04bd-4555-8047-a542e977117b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:08.599684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:08.600325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:08.600606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:08.600878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:08.610974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:08.612411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc882d-aff2-4f89-8061-dda449323be8 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:08.622177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 774/1534] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:12.417643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:12.418247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:12.418247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:12.419964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:12.427036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18634d-0f0f-4643-8baf-a674bbe40acf None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:12.427482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18634d-0f0f-4643-8baf-a674bbe40acf None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:12.427588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18634d-0f0f-4643-8baf-a674bbe40acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:12.449703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6e18634d-0f0f-4643-8baf-a674bbe40acf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:12.451045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6e18634d-0f0f-4643-8baf-a674bbe40acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:12.462939 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:12.721253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:12.723033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:12.782569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c312c-ecf2-4cf4-bcba-06d01b9a8bb6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:12.786545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:12.787187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:12.787461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:12.787736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:12.796690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:12.798145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad93a-b6e9-4c94-93d8-f0099c040705 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:12.807449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 762/1537] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:16:15.117440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59bc9-9bd9-4a29-9d0c-4cb21a904a92 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:15.118410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59bc9-9bd9-4a29-9d0c-4cb21a904a92 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:15.118410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a59bc9-9bd9-4a29-9d0c-4cb21a904a92 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:15.121603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 776/1538] 127.0.0.1 () {54 vars in 916 bytes} [Sun Mar 20 16:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:15.127184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46105-0852-49a7-83d6-94f7d35a8c20 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:15.127639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46105-0852-49a7-83d6-94f7d35a8c20 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:15.127754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46105-0852-49a7-83d6-94f7d35a8c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:15.145729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9ab46105-0852-49a7-83d6-94f7d35a8c20 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:15.146948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9ab46105-0852-49a7-83d6-94f7d35a8c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:15.155184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 763/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Mar 20 16:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:16:15.410220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404b2e-0b31-4c79-88b3-1d498a8436f2 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:15.410750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404b2e-0b31-4c79-88b3-1d498a8436f2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:15.411187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404b2e-0b31-4c79-88b3-1d498a8436f2 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:15.414039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 777/1540] 10.222.0.18 () {54 vars in 962 bytes} [Sun Mar 20 16:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:16:15.421069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb884-3e25-4ca3-afdd-00bc9129a39e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:15.421354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb884-3e25-4ca3-afdd-00bc9129a39e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:15.421633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb884-3e25-4ca3-afdd-00bc9129a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:15.440111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f1feb884-3e25-4ca3-afdd-00bc9129a39e None None] MFA Rules not processed for user `e4d9cf83f9e241549009f2e8b56e5767`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:16:15.441293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f1feb884-3e25-4ca3-afdd-00bc9129a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:16:15.447892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 764/1541] 10.222.0.18 () {58 vars in 1059 bytes} [Sun Mar 20 16:16:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:16:15.457518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db404b2e-0b31-4c79-88b3-1d498a8436f2 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:16:15.469517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db404b2e-0b31-4c79-88b3-1d498a8436f2 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:16:15.473154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:16:15.473779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:16:15.474058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:16:15.474350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:16:15.483734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:16:15.485151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82555cf8-bdd9-45b9-b569-9698e21f5fd0 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:16:15.494659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 778/1542] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:41.420082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e7210-6545-4e19-8ee3-520c3dbff0e8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.421172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e7210-6545-4e19-8ee3-520c3dbff0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.421646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e7210-6545-4e19-8ee3-520c3dbff0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.456772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-018e7210-6545-4e19-8ee3-520c3dbff0e8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.462613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-018e7210-6545-4e19-8ee3-520c3dbff0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.472616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 765/1543] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.482359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.483339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.483826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.492870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab3b3-8784-46a3-bd23-ee8a8e299645 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.495425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab3b3-8784-46a3-bd23-ee8a8e299645 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.497953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab3b3-8784-46a3-bd23-ee8a8e299645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.522692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-189ab3b3-8784-46a3-bd23-ee8a8e299645 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.523409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.524498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-189ab3b3-8784-46a3-bd23-ee8a8e299645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.524632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.537153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 779/1544] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.539825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 766/1545] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.552061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:41.553424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.553908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.554521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.566721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376c00-df55-473f-b9ff-07b0c4c6bdbf None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:41.582814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.583071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:41.583743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.584029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.584305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.585059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:41.585187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.585361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:41.586425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:41.586425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:17:41.586425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:17:41.587938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:41.607986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 767/1546] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.608206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 780/1547] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:41.617152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:41.618850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:41.635898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a646a8-e9e5-4059-bf4c-a8493b201fd3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:41.639550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51beb0-3b3b-4ffc-bc98-803608440f80 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:41.644420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:41.644731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:41.645136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.645390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.645524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.645693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.645806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.645965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.646425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:41.646731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:41.648385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:41.651050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:41.652935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0c5db-54aa-4220-8b50-85762cc64127 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:41.673699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 768/1548] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:41.686359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:41.698853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba172f-73ab-42e9-bc78-774403ff7703 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:41.707354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 781/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:17:41.711587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.711875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.712150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.749821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.751555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.810524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:41.811529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.811812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.812090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.812789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:41.813848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:41.813848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:17:41.813848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:17:41.815074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b3498-6072-46f0-973a-8426b8797e41 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:41.829939 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 782/1550] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.831059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:41.840646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa20ccc-fab4-4009-8877-1f4ffd039984 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:41.842451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 769/1551] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:17:41.843598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a1c47-9267-4d3b-bdb5-10b380b9c4a6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.843883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a1c47-9267-4d3b-bdb5-10b380b9c4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.844224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a1c47-9267-4d3b-bdb5-10b380b9c4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.860612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0d1a1c47-9267-4d3b-bdb5-10b380b9c4a6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.861789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0d1a1c47-9267-4d3b-bdb5-10b380b9c4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.893832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:41.894640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.894917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.895190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.895871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:41.896883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:41.896883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:17:41.896883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:17:41.898064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a0133-7260-445f-86a9-03ffab54b300 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:41.923022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 783/1552] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:41.923022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4d5e-bf9f-4ea4-8103-4828940377e6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.923022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4d5e-bf9f-4ea4-8103-4828940377e6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.923022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4d5e-bf9f-4ea4-8103-4828940377e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.935808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 770/1553] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.935808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212d7a5-ea14-49f9-bbf1-9dc799f7b3c7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.935808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212d7a5-ea14-49f9-bbf1-9dc799f7b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.935808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212d7a5-ea14-49f9-bbf1-9dc799f7b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.939106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f2ed4d5e-bf9f-4ea4-8103-4828940377e6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.940308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f2ed4d5e-bf9f-4ea4-8103-4828940377e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.948622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 784/1554] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.949919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ff7f-71af-46c1-a27f-88481b549cb6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.950269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ff7f-71af-46c1-a27f-88481b549cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.950553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302ff7f-71af-46c1-a27f-88481b549cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.953148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6212d7a5-ea14-49f9-bbf1-9dc799f7b3c7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.954356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6212d7a5-ea14-49f9-bbf1-9dc799f7b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.962519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 771/1555] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.963843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.964130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.964406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.976160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2302ff7f-71af-46c1-a27f-88481b549cb6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.977356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2302ff7f-71af-46c1-a27f-88481b549cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.981560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:41.982729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:41.985440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 785/1556] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.986653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:41.986929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:41.987199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:41.998876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 772/1557] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:41.999664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.006217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.007506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.008786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37c871-9dd4-4bbd-88cc-68d0e08b7374 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.013522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.014179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.014497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.014765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.015444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.016347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 786/1558] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.017271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.017381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67536db4-5173-47e8-8c20-b4d19a9211c0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.026947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b005b-04ff-4f1a-be7a-98f1c66d0435 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.032531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.033192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.033474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.033747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.034517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.036110 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750f6dd-e4b7-48d6-b1f2-351f24ac0c8e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.037294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 773/1559] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:41 2022] POST /identity/v3/users => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.038651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a881d-b9b4-43a2-99ca-ec4e396d4cfb None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.038936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a881d-b9b4-43a2-99ca-ec4e396d4cfb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.039208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a881d-b9b4-43a2-99ca-ec4e396d4cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.046878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 787/1560] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.048109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ff86-ba60-4368-be77-b3948e6444a2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.048398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ff86-ba60-4368-be77-b3948e6444a2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.048673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ff86-ba60-4368-be77-b3948e6444a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.060151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-478a881d-b9b4-43a2-99ca-ec4e396d4cfb None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.061338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-478a881d-b9b4-43a2-99ca-ec4e396d4cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.069311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2f67ff86-ba60-4368-be77-b3948e6444a2 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.069697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 774/1561] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.070678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2f67ff86-ba60-4368-be77-b3948e6444a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.071049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c465-07d4-4803-a80b-d9950e6a8cba None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.071334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c465-07d4-4803-a80b-d9950e6a8cba None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.071680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c465-07d4-4803-a80b-d9950e6a8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.078827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 788/1562] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.078827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.078827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.078827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.089322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5f12c465-07d4-4803-a80b-d9950e6a8cba None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.090502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5f12c465-07d4-4803-a80b-d9950e6a8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.098585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 775/1563] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.098831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.099607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.099893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.100160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.100438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.108535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 789/1564] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.109376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.118389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.118567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eaa34-c4af-44b9-8867-ddfa02ec5d08 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.119538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.123267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.123872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.124152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.124429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.125141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.125446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.127080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.127908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 776/1565] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.128491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.138815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 790/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.139601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.141006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119b1f2-1e4a-404a-abda-840f44d509db None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.145853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.146856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.147038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.147308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.148024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.149075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e287-2cda-4675-88bf-200d1ac36ab1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.149623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.153851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.154529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.155246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.155246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.155788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.157397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.159702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 777/1567] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.160479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.170762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 791/1568] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.170762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.173391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf9de2-f344-4617-b464-34f6f2a0abeb admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.177619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa05a1-6a83-4411-b1f2-66baa3815af7 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.178442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.179263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.179543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.179816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.180528 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.180833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.182192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.182430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.182832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.183109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.183378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.184079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.184374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.185986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.194543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 778/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.195246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.198212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 792/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.199589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.209829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87169d-355a-43d5-ae38-cb8981c01432 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.209991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d6e-e4f0-4ac0-b5ea-a94de90e01f0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.214302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.214466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.214950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.215107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.215214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.215382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.215493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.215653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.216221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.216431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.216552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.216730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.218077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.218317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.236800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 779/1571] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.236800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.237098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 793/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.237098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.244363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb358-f93a-4d4b-bf65-2b2e03bd1f60 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.246738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b193e-aa14-4370-a023-06cc0a49e672 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.249317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.249965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.250245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.250558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.251244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.251433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.252067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.252365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.252614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.253325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:42.253472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.253620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.255230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.267123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 780/1573] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:42.267973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.277343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb61b2-056e-468f-826e-0d3c66dafbab admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.282472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.283128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.283420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.283693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.284406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.285978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.287331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 794/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.291075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.295730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 781/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.296483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.305676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ade9-1183-4a5f-a9ca-9fd5efe79740 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.353359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88d06-4533-4f7f-a601-e46640348bd4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.358001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.358923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.359198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.359472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] PATH_INFO: `/v3/projects/a2d376375ec24e48b36d239d57485b45/users/3e586ca2f9b940bca0511b2d6bdd7cb1/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.359624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.360147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.360423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.360693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.361364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.363291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.373749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d376375ec24e48b36d239d57485b45, user_id=3e586ca2f9b940bca0511b2d6bdd7cb1, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.376439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.388070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 782/1576] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.389028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.397602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 795/1577] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:42 2022] PUT /identity/v3/projects/a2d376375ec24e48b36d239d57485b45/users/3e586ca2f9b940bca0511b2d6bdd7cb1/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:42.397602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.453251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39600-3679-4489-8f32-657d2af4ae3b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.454476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5ad96-b280-48c9-be12-0982a2310676 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.457845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.458536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.458821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.459034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.459171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.459680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.459800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.459956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.460226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.460902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.461662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.462810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.492332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 796/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.492332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.493280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 783/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.493280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.552431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acabd5-5faa-4615-a7cb-dc4e8b3263f2 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.553074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd05db-5641-4958-a174-70ecb4471a3d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.557075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.557558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.557734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.558009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.558220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.558340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.558534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.558810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.558997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.559488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.560953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.561414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.586622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 784/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.587485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.590124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 797/1581] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.591054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.647175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e328a-c280-4fc2-86f0-7088785a8a6c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.649963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958c80-0ce5-4975-b3c8-963738668202 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.651743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.652417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.652721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.652994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.653715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.654780 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.655702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.655818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.656062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.656330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] PATH_INFO: `/v3/projects/8a10e45107a64ade9bec7c825fe362bc/users/1a796c88305745049007e4b578fdaf21/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.670885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a10e45107a64ade9bec7c825fe362bc, user_id=1a796c88305745049007e4b578fdaf21, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.673697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b6e3a-b06a-467a-9a0f-370338d134e3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.676386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 785/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.679296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.687098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 798/1583] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:42 2022] PUT /identity/v3/projects/8a10e45107a64ade9bec7c825fe362bc/users/1a796c88305745049007e4b578fdaf21/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:42.688333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.688441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59a021-edc3-4926-9ea1-1a489ffed5c9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.688615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.688885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.713512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] MFA Rules not processed for user `3e586ca2f9b940bca0511b2d6bdd7cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.714734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.750492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.751167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.751443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.751712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.752397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.754320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.777530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 786/1584] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.779195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 799/1585] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.782636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.782871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.792735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54317a67-ae54-4857-8815-6d0ee04e8f63 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.796850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df070-1d39-4da4-9dbb-c72355e18997 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.797439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.798108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.798400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.798693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.799516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.801458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.801858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.802615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.802840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.803101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.803794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.805701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.826759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 800/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.826759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.827412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 787/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.828164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.834059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef476f-ce08-4fec-8678-84bf569dd0cd admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.837795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939816b-f2db-4495-b6b1-ac5a1059cbb4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.840459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.841469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.841885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.842344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.842641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.843286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.843404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.843568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.843841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.844513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.846453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde10a-06d6-4ecc-8174-a62b9cb95f55 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.846691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.870211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 788/1588] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.871407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.874828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 801/1589] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.874828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.874828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.874828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.884503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2250e5-d5ad-4915-b4d2-d82174d0a075 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.889874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.890571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.890845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.891104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:42.891203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.891813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.892285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:42.893391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.900580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 802/1590] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:42.903085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.906051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 789/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.906051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.914003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb103-ea1f-40d1-b390-4e0b7fdcb9d5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.916029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2ef2-08ec-46d1-b4b2-ec1520db430f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.919581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.920215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.920489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.920753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.920852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.921453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.921563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.921735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.922006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.922766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.923393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.924362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.937400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 803/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.937400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.945241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2c5-623f-426c-837d-37139621ecb2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:42.949650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:42.950400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:42.950679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:42.950949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:42.951657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:42.952246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 790/1593] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:42 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:42.952246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.955444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:42.965657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 804/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:42.965657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:42.974434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f63d4-7cd0-46e3-a92e-ffe14292e834 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.012450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53495-afcf-4157-bc55-ddba2d550f8b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.016921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.017581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.017856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.018125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.018880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.020471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.028079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.028944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.029201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.029521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.030237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.031188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 791/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.032047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.032165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.041734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd06a1-f2c7-4004-aaf2-5d1bb16ebc14 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.042090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 805/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.043044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.046692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.047370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.047651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.047926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.048638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.050220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.052344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1462-450c-4035-9bb2-1c2d3305bfb4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.056873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.057434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.057706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.057975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.058713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.060096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 792/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.060294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.060894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.073083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 806/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.073083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.079957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9611b-d917-4da0-959e-d0655635d26e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.084399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.085026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.085301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.085567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.086290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.087857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.097476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 807/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.098785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.107877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a74c5-daa9-40d2-be8e-428fe71601ab admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.112362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.113022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.113294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.113558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.114190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.116139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.117611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e8f7-a701-45cb-8066-00f9a361f232 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.121595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.122432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.122731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.122984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.132839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.134587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.141983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 808/1600] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:43.141983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.144878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 793/1601] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:43.145695 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.150199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f131-6844-4e0f-b372-047fbc95dd78 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.155096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.155260 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea15c0-2925-4abe-a6c8-34e93d8a25fd service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.155763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.156048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.156319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.157033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.158796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.161020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.161543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.161823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.162091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.162852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.164457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.171155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 809/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.171951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.182025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 794/1603] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.182025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.185096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4fcb-630a-417d-b736-6fea8733af26 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.191258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.191937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.192217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.192740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.193441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.194761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114785b-ae24-4455-b773-f647b3a676d8 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.195074 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.199653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.200744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.200744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.200955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.201598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.203411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.212567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 810/1604] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.212567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.219682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 795/1605] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.219682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.227249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531e0b-7821-4325-b203-8cde3fc64ff0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.228367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5396-1c93-4ffa-ad3d-9470cf113c9e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.232837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.232991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.233734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.234534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.234673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.234766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.234872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] PATH_INFO: `/v3/projects/0f94912f17654e538c0c2c0800da01af/users/55d5039dd3c24e6fb599040a9f22083a/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.234953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] PATH_INFO: `/v3/projects/bd30e021475547fea71a24a023e0fe49/users/e69d0561fe714fab9b7171faf257742c/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.251462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f94912f17654e538c0c2c0800da01af, user_id=55d5039dd3c24e6fb599040a9f22083a, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.252534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd30e021475547fea71a24a023e0fe49, user_id=e69d0561fe714fab9b7171faf257742c, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.253782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:43.253782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:17:43.253782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:17:43.255163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.255757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.270145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 811/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/0f94912f17654e538c0c2c0800da01af/users/55d5039dd3c24e6fb599040a9f22083a/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.271378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.274321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 796/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/bd30e021475547fea71a24a023e0fe49/users/e69d0561fe714fab9b7171faf257742c/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.275381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.345422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed15df-af0f-4122-9336-54e71a1cfe41 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.346597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9d69b-221a-4437-80b7-0e71510cef42 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.350052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.350997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.351272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.351537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] PATH_INFO: `/v3/projects/6d36d10d56cc45bcb8f737c8245935ac/users/eb902201a42144e190a4237f4e568adf/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.352078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.352800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.353084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.353355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.354366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.357048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.367137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d36d10d56cc45bcb8f737c8245935ac, user_id=eb902201a42144e190a4237f4e568adf, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.369605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 812/1608] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:43.370202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.374029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.384395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9ee8e-c95b-4e57-be67-a026546b5259 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.386813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 797/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/6d36d10d56cc45bcb8f737c8245935ac/users/eb902201a42144e190a4237f4e568adf/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.387722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.453372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b77f28-c459-4c05-bf19-99d91390fa03 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.453915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.453915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.453915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.453915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] PATH_INFO: `/v3/projects/1e13752dda554900a802538d520b801f/users/7b7c26f503104a7fb08b0ca79a2b8ad6/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.466034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.467193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.467499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.467775 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] PATH_INFO: `/v3/projects/4d7d306143f24141a45d4bed4df19c97/users/ea2da369763b4fee8d87ff9f6bf25ae3/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.472810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e13752dda554900a802538d520b801f, user_id=7b7c26f503104a7fb08b0ca79a2b8ad6, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.475682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.483595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7d306143f24141a45d4bed4df19c97, user_id=ea2da369763b4fee8d87ff9f6bf25ae3, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.486830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86723226-8d8d-4d71-b729-3e5b46327dc8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.491649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 813/1610] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/1e13752dda554900a802538d520b801f/users/7b7c26f503104a7fb08b0ca79a2b8ad6/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.492584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.510530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 798/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/4d7d306143f24141a45d4bed4df19c97/users/ea2da369763b4fee8d87ff9f6bf25ae3/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.511816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9d1c-2be1-4718-ad5e-c0c60390f8ef None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.512103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9d1c-2be1-4718-ad5e-c0c60390f8ef None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.512374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9d1c-2be1-4718-ad5e-c0c60390f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.532543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-94ca9d1c-2be1-4718-ad5e-c0c60390f8ef None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.534027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-94ca9d1c-2be1-4718-ad5e-c0c60390f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.559093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37f4b-4945-48d4-aba9-0fb8a92eb132 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.595647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 799/1612] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:43.596929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368b164-02a7-4b5a-a69e-6d020f3bdbc8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.597212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368b164-02a7-4b5a-a69e-6d020f3bdbc8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.598212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368b164-02a7-4b5a-a69e-6d020f3bdbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.626995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.628636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.628768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0368b164-02a7-4b5a-a69e-6d020f3bdbc8 None None] MFA Rules not processed for user `55d5039dd3c24e6fb599040a9f22083a`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.629076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.630160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0368b164-02a7-4b5a-a69e-6d020f3bdbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.630338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] PATH_INFO: `/v3/projects/ee6c1373cfca4082bb000ddeb48e6155/users/8fe6db1f6d934ba0bd95826e6c76c556/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.647628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c1373cfca4082bb000ddeb48e6155, user_id=8fe6db1f6d934ba0bd95826e6c76c556, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.650412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.667994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 814/1613] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/ee6c1373cfca4082bb000ddeb48e6155/users/8fe6db1f6d934ba0bd95826e6c76c556/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.668570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.712776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 800/1614] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:43.714839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3729a-796b-4a31-80aa-723c38a8c928 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.715631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3729a-796b-4a31-80aa-723c38a8c928 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.716031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3729a-796b-4a31-80aa-723c38a8c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.736403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-41f3729a-796b-4a31-80aa-723c38a8c928 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.737934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-41f3729a-796b-4a31-80aa-723c38a8c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.739666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bf99e-5f91-4cd0-84d0-6aee8830aa82 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.744924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.745870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.746603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.746873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] PATH_INFO: `/v3/projects/0a8cecf40ba3436d9354bf6239ef54af/users/1e13763f798b45c5a3efa3a78ebe9b6c/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.747691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 801/1615] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:43.748776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.749182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.749554 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.771911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8cecf40ba3436d9354bf6239ef54af, user_id=1e13763f798b45c5a3efa3a78ebe9b6c, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:43.774599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434dd63-ca98-4e1f-a9b2-0dfce36557f7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:43.776288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] MFA Rules not processed for user `7b7c26f503104a7fb08b0ca79a2b8ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.778820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.790833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 815/1616] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:43 2022] PUT /identity/v3/projects/0a8cecf40ba3436d9354bf6239ef54af/users/1e13763f798b45c5a3efa3a78ebe9b6c/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:43.792099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b645-6d81-4c48-857b-929d07f80019 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.792381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b645-6d81-4c48-857b-929d07f80019 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.792783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b645-6d81-4c48-857b-929d07f80019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.818586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ca41b645-6d81-4c48-857b-929d07f80019 None None] MFA Rules not processed for user `ea2da369763b4fee8d87ff9f6bf25ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.819789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ca41b645-6d81-4c48-857b-929d07f80019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.846391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 802/1617] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:43.847266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:43.848693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.891125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 816/1618] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:43.893610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.893900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.894170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:43.920057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:43.921185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1693-68ea-4a8c-a870-ab35e9d97060 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:43.921609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:43.989423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:43.990400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:43.990997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:43.991431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.006289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 817/1619] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:44.007137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.016563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a3bf0-3d9f-4850-8ccb-af29c4a45a20 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.021195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.021854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.022133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.022438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.023122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.025293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.054928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 818/1620] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:44.059014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.061314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.063076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.074439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 803/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:44.075652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.089003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678db4d1-3575-40e7-b4b2-125096bb7017 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.118238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890eb5-adb6-451f-b275-ade501459ca7 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.122470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.123307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.123903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.124381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.165765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.166692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.167070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.167440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.168453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.170518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af551e-62b4-433f-9132-cbdcb096bf8a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.185985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 804/1622] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:44.185985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e345d-4170-4b9a-9a5d-5903d78bfba9 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.185985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e345d-4170-4b9a-9a5d-5903d78bfba9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.185985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e345d-4170-4b9a-9a5d-5903d78bfba9 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.187545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 805/1623] 10.222.0.18 () {54 vars in 959 bytes} [Sun Mar 20 16:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:17:44.188441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e345d-4170-4b9a-9a5d-5903d78bfba9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.202426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e345d-4170-4b9a-9a5d-5903d78bfba9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.203204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.204653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54de56-4ef4-4095-a4e3-e2270025c4ef service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.209265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.210382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.210796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.211087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.211809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.213762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.216464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 819/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:44.218065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.218065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.218630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.250372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 806/1625] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:44.250372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.256282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] MFA Rules not processed for user `1a796c88305745049007e4b578fdaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:44.257820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:44.315370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e80a0-9944-4c3c-9889-380ee8d84f3f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.319079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.319919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.320240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.320516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.343881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 820/1626] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:44.344506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.385444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.386998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.397064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 807/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:44.397700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.409043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431afb9-f09c-47cb-af87-fe7910689176 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.416015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f625-2942-4c8d-bfeb-43ab88b808d1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.417438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.418736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.419207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.420232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] PATH_INFO: `/v3/projects/0a8cecf40ba3436d9354bf6239ef54af/users/1e13763f798b45c5a3efa3a78ebe9b6c/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.422174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8cecf40ba3436d9354bf6239ef54af, user_id=1e13763f798b45c5a3efa3a78ebe9b6c, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.422531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.424150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.424150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.424351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.425247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.425911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e30ca-a138-42f0-999f-c863307af9eb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.427678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.438787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 808/1628] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:44 2022] PUT /identity/v3/projects/0a8cecf40ba3436d9354bf6239ef54af/users/1e13763f798b45c5a3efa3a78ebe9b6c/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:44.447809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4656-eb29-418e-9b60-b0a057755c06 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.447809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4656-eb29-418e-9b60-b0a057755c06 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.447809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4656-eb29-418e-9b60-b0a057755c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.461761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 821/1629] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:44.462920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.469488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e3fd4656-eb29-418e-9b60-b0a057755c06 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:44.470678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e3fd4656-eb29-418e-9b60-b0a057755c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:44.477468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0424cd-4411-4299-9d89-14fadeb25c14 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.556224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.556960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.557166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.557442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.558114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.560458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5446-4584-4f89-8998-a139cf303d2c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.597283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 809/1630] 10.222.0.18 () {58 vars in 1056 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:44.599009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.599573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.600291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.605590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 822/1631] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:44.607312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.607495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.607759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.627034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] MFA Rules not processed for user `1a796c88305745049007e4b578fdaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:44.629218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:44.660185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] MFA Rules not processed for user `1e13763f798b45c5a3efa3a78ebe9b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:44.661439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:44.724623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 810/1632] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:44.729211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.744991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06df08-755d-4ca2-85fa-9f927af0520c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.750432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.751116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.751411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.751665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.752405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.753996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.769611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 811/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:44.770586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.776055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 823/1634] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:44.777573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.783437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552fde-a360-4970-9530-b6042fc62937 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.788502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.789455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.790297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.790297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.791145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.793464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a8a4-3da1-42b7-bc3b-a7809b6ff713 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.808227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 812/1635] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:44.808456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff7b0-dd3b-4c2c-a52d-20bc8c228933 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.808569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a996-8956-42f7-894c-3450b175fd16 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.808569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a996-8956-42f7-894c-3450b175fd16 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.808569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a996-8956-42f7-894c-3450b175fd16 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.809875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 813/1636] 10.222.0.18 () {54 vars in 959 bytes} [Sun Mar 20 16:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:17:44.810713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a996-8956-42f7-894c-3450b175fd16 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.819771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.820583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.820869 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.821144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.824847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a996-8956-42f7-894c-3450b175fd16 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.830968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.832174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.832476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.832719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] PATH_INFO: `/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275/users/82241200ed604d2e96c7404477014a85/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.851703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52eeb450bf14ca7aaa60a7822bd9275, user_id=82241200ed604d2e96c7404477014a85, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.854519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.877758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 814/1637] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:44 2022] PUT /identity/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275/users/82241200ed604d2e96c7404477014a85/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:44.878707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.920247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:44.923646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:44.936249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cfb6-4715-4019-887a-4478db3d729c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:44.939052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 824/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:44.940066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:44.952351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:44.953108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:44.953291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:44.953572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:44.956242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012013-4c55-44c9-9aec-57fdbbd66977 service nova] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.045827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.046991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.048778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.049197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] PATH_INFO: `/v3/projects/e8efd55994c94bef8b6352c38933e8ec/users/9f640c582a734a7aa3e40b99feb165d3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.091101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8efd55994c94bef8b6352c38933e8ec, user_id=9f640c582a734a7aa3e40b99feb165d3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.097201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8e3bb-c003-408f-bb08-a859d30c1909 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.107868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.109693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.127150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 825/1639] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:44 2022] PUT /identity/v3/projects/e8efd55994c94bef8b6352c38933e8ec/users/9f640c582a734a7aa3e40b99feb165d3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:45.127150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472aac7-544c-474f-9100-5869909d678f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.127954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472aac7-544c-474f-9100-5869909d678f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.127954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472aac7-544c-474f-9100-5869909d678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.137047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 815/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:45.138051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.164812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437993a-204b-4796-a87d-66f6f68cca59 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.174632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2472aac7-544c-474f-9100-5869909d678f None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:45.179207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2472aac7-544c-474f-9100-5869909d678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:45.282286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.283171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.283692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.284103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.284990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.287512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.299990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 816/1641] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:45.301260 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.310636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 826/1642] 10.222.0.18 () {58 vars in 1056 bytes} [Sun Mar 20 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:45.312634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb94e-2210-410b-9763-39a55e2c3d4b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.313267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4d27a-1509-4ab8-a2cc-66198b1b7902 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.314025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4d27a-1509-4ab8-a2cc-66198b1b7902 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.314433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4d27a-1509-4ab8-a2cc-66198b1b7902 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.317341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 827/1643] 10.222.0.18 () {54 vars in 912 bytes} [Sun Mar 20 16:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:17:45.318432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4d27a-1509-4ab8-a2cc-66198b1b7902 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.322878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.323560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.323970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.324428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.325318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.327521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.343516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 817/1644] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:45.344684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.348252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4d27a-1509-4ab8-a2cc-66198b1b7902 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.362473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.363587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.364039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.364463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] PATH_INFO: `/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275/users/82241200ed604d2e96c7404477014a85/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.367048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52eeb450bf14ca7aaa60a7822bd9275, user_id=82241200ed604d2e96c7404477014a85, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.370045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fad15e-5bd9-4c52-a0ad-149172054f79 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.372143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b410-9f3e-4bb5-a6c4-fa5ecfe6de52 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.383871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.384522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.384834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.385080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.389817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 828/1645] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:45 2022] PUT /identity/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275/users/82241200ed604d2e96c7404477014a85/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:45.392186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cb71-ae8e-4f4a-a6e1-f6e4d3540fb1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.392903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cb71-ae8e-4f4a-a6e1-f6e4d3540fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.393329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cb71-ae8e-4f4a-a6e1-f6e4d3540fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.438210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7ee9cb71-ae8e-4f4a-a6e1-f6e4d3540fb1 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:45.439518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7ee9cb71-ae8e-4f4a-a6e1-f6e4d3540fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:45.537129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.547943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.578048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 818/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:45.580183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.595651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857b26-3d1d-4bb0-95ae-13242ac38bcd service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.617444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 829/1647] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:45.618949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2ad34-0bb9-4003-b520-fd816c5452e6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.619248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2ad34-0bb9-4003-b520-fd816c5452e6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.619504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2ad34-0bb9-4003-b520-fd816c5452e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.698757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-80e2ad34-0bb9-4003-b520-fd816c5452e6 None None] MFA Rules not processed for user `82241200ed604d2e96c7404477014a85`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:45.701957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-80e2ad34-0bb9-4003-b520-fd816c5452e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:45.737187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.739568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.739841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.740109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] PATH_INFO: `/v3/projects/e8efd55994c94bef8b6352c38933e8ec/users/9f640c582a734a7aa3e40b99feb165d3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.747124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8efd55994c94bef8b6352c38933e8ec, user_id=9f640c582a734a7aa3e40b99feb165d3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:45.753569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:45.792993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 819/1648] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:45 2022] PUT /identity/v3/projects/e8efd55994c94bef8b6352c38933e8ec/users/9f640c582a734a7aa3e40b99feb165d3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:45.792993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:45.889491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 830/1649] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:45.890577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.890867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.891145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.914416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2506-9b37-496c-8615-bc5f1b727db9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:45.926884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:45.928011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:45.928500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:45.928990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:45.950815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] MFA Rules not processed for user `9f640c582a734a7aa3e40b99feb165d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:45.952036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.045021 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:46.047405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:46.066061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 820/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:46.067557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.086413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 831/1651] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:46.087287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.106179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fc007-6bbb-4a8b-95fe-58ea5b5298d4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.113310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.113981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.114281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.114565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.230697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:46.233138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e2f17-c516-46a0-9650-c3362ab9bfc8 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:46.234780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e03b7e-5b3f-4657-b69b-82ed26bc1bbb service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.245462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.246825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.247275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.247641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] PATH_INFO: `/v3/users/3e586ca2f9b940bca0511b2d6bdd7cb1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.249195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e586ca2f9b940bca0511b2d6bdd7cb1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:46.250467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: WARNING py.warnings [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:46.250467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: warnings.warn(msg) Mar 20 16:17:46.250467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: Mar 20 16:17:46.251915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:46.252985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 832/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:46.255603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253486-dfb0-4af0-8871-e8396c2da172 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.257132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253486-dfb0-4af0-8871-e8396c2da172 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.258658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253486-dfb0-4af0-8871-e8396c2da172 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.272785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 833/1653] 10.222.0.18 () {54 vars in 912 bytes} [Sun Mar 20 16:17:46 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:17:46.277053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.277343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.277618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.320202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:46.321716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.343461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 834/1654] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:46.354065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.371359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b396d-c5c6-4bbd-ac2c-966ed0e46de2 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.380273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.381187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.381601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.381965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.404932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:46.407580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:46.420115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e586ca2f9b940bca0511b2d6bdd7cb1'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:46.433884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 835/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:17:46.448815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.449040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e586ca2f9b940bca0511b2d6bdd7cb1'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:46.450612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e586ca2f9b940bca0511b2d6bdd7cb1'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:46.454391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.468114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e586ca2f9b940bca0511b2d6bdd7cb1'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:46.498129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e4f6d0-fc5e-46c6-8039-21669183c4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e586ca2f9b940bca0511b2d6bdd7cb1'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:46.504985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 821/1656] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:46 2022] DELETE /identity/v3/users/3e586ca2f9b940bca0511b2d6bdd7cb1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:46.510280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.510470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.510665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.546220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:46.547406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.550724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e165bf-0076-47d2-b256-617e0c1e4112 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.611084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.619012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.620198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.620714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.624323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.702864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 822/1657] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:17:46.706536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.709397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.782669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:46.784383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:46.814368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 836/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:46.815231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:46.818652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.851479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f34259-8033-4d31-8aef-c14b84d06a8f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.858274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.859680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.860196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.861743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:46.864463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:46.947007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4350-e1f6-493e-8af0-80dd6772790e service glance] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:46.962683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:46.967604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:46.967778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:46.968060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:47.001846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:47.007649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:47.007846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:47.013421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2aba4-887a-4a8d-aec2-0d80eebe18df service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:47.033440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 823/1659] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:47.035334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:47.039304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:47.046772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 837/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:47.069422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be1da-1685-4e10-bf44-9d46638459bc service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:47.080883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:47.081574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:47.081851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:47.082119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:47.090739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:47.240772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:47.244047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a3079-b9a8-45a5-a6aa-f434700fd52c service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:47.276593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 824/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:47.523818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd9ff-8fcd-4e13-bc23-e63df0ab4410 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:47.524104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd9ff-8fcd-4e13-bc23-e63df0ab4410 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:47.524384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd9ff-8fcd-4e13-bc23-e63df0ab4410 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:47.527095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 838/1662] 10.222.0.18 () {54 vars in 912 bytes} [Sun Mar 20 16:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:17:47.533251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:47.533538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:47.533797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:47.614245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:47.618715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:47.640334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 825/1663] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:47.696094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd9ff-8fcd-4e13-bc23-e63df0ab4410 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:47.715434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd9ff-8fcd-4e13-bc23-e63df0ab4410 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:47.720548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:47.721692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:47.722413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:47.723042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:47.734764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:47.737354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:47.750502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 839/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:48.429689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:48.431476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:48.467373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee94e2-060c-4e55-b062-11a471c8cf5c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:48.473125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:48.474040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:48.474347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:48.474624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] PATH_INFO: `/v3/projects/a2d376375ec24e48b36d239d57485b45` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:48.478922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d376375ec24e48b36d239d57485b45)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:48.482906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:48.590963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d376375ec24e48b36d239d57485b45', 'request_id': 'req-268577dc-d9a4-4773-96d7-6ee287d50bf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:48.599128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d376375ec24e48b36d239d57485b45', 'request_id': 'req-268577dc-d9a4-4773-96d7-6ee287d50bf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:48.605526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d376375ec24e48b36d239d57485b45', 'request_id': 'req-268577dc-d9a4-4773-96d7-6ee287d50bf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:48.624730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] The token cache is being invalidate because project a2d376375ec24e48b36d239d57485b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:48.625332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:48.626114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-268577dc-d9a4-4773-96d7-6ee287d50bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:48.629069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 826/1665] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:48 2022] DELETE /identity/v3/projects/a2d376375ec24e48b36d239d57485b45 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:48.633302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:48.669380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfba2e-4ddb-4edc-b97f-3b83ae9925b4 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:48.788039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d6dd-0047-4179-b1ec-5d3719d21efb None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:48.788942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d6dd-0047-4179-b1ec-5d3719d21efb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:48.789448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d6dd-0047-4179-b1ec-5d3719d21efb None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:48.791859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 827/1666] 10.222.0.18 () {54 vars in 960 bytes} [Sun Mar 20 16:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 20 16:17:48.798407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:48.799217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:48.799601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:48.850766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] MFA Rules not processed for user `54281300b2394a829de25d19bebde181`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:48.852558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:48.854033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:48.854519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:48.854957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] PATH_INFO: `/v3/users/1e13763f798b45c5a3efa3a78ebe9b6c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:48.855245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:48.856580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e13763f798b45c5a3efa3a78ebe9b6c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:48.863206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:48.982412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e13763f798b45c5a3efa3a78ebe9b6c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:49.004572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e13763f798b45c5a3efa3a78ebe9b6c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:49.005449 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e13763f798b45c5a3efa3a78ebe9b6c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:49.006247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e13763f798b45c5a3efa3a78ebe9b6c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:49.035479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 828/1667] 10.222.0.18 () {58 vars in 1057 bytes} [Sun Mar 20 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 20 16:17:49.037765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:49.039348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e13763f798b45c5a3efa3a78ebe9b6c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:49.056001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 840/1668] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:48 2022] DELETE /identity/v3/users/1e13763f798b45c5a3efa3a78ebe9b6c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:49.059858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db838e2-ea58-4d7e-8fd2-cf7941342242 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:49.141226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:49.141961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:49.142246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:49.142581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:49.144553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:49.163478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:49.165348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:49.178019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 829/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:50.808966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:50.811008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:50.975028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d755-8c7b-4e0a-8bd2-7e1ac3114fc8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:50.986958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:50.989771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:50.990607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:50.990939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:50.993151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] PATH_INFO: `/v3/users/7b7c26f503104a7fb08b0ca79a2b8ad6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:50.993286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:50.997767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7c26f503104a7fb08b0ca79a2b8ad6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.000079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:51.045669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfb99-357f-4875-a9c6-d301c4c0fee9 service placement] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:51.061999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:51.063069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.064560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.065459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] PATH_INFO: `/v3/projects/0a8cecf40ba3436d9354bf6239ef54af` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.070981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8cecf40ba3436d9354bf6239ef54af)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.076763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:51.096103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7c26f503104a7fb08b0ca79a2b8ad6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.114214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7c26f503104a7fb08b0ca79a2b8ad6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.115272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7c26f503104a7fb08b0ca79a2b8ad6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.116275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7c26f503104a7fb08b0ca79a2b8ad6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.146935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8cd6f24-aeb6-4628-9826-031516b105b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7c26f503104a7fb08b0ca79a2b8ad6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.193748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 841/1670] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:50 2022] DELETE /identity/v3/users/7b7c26f503104a7fb08b0ca79a2b8ad6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:51.195533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.199815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.209682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.211622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8cecf40ba3436d9354bf6239ef54af', 'request_id': 'req-983b33ab-80f4-4c86-8496-ba8cb2a52125'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.236925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8cecf40ba3436d9354bf6239ef54af', 'request_id': 'req-983b33ab-80f4-4c86-8496-ba8cb2a52125'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.254742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8cecf40ba3436d9354bf6239ef54af', 'request_id': 'req-983b33ab-80f4-4c86-8496-ba8cb2a52125'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.267520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:51.268758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.285759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] The token cache is being invalidate because project 0a8cecf40ba3436d9354bf6239ef54af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:51.286022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.286698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-983b33ab-80f4-4c86-8496-ba8cb2a52125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.296627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 830/1671] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:50 2022] DELETE /identity/v3/projects/0a8cecf40ba3436d9354bf6239ef54af => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:17:51.298681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.299128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.300331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.351085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:51.355742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.433696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 842/1672] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:51.458056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:51.460392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.565829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 831/1673] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:51.566696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:51.571142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.584615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd921b-0665-47bc-a6e5-f560c1fe55e8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:51.588363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:51.589029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.589309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.589710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.602149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864876a-85f1-4f3a-ba68-da8baa9837f1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:51.613987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:51.615119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.615432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.615708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] PATH_INFO: `/v3/users/ea2da369763b4fee8d87ff9f6bf25ae3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.618316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.622388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3fd35-8a38-4483-9775-140c02b9334b service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:51.623707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2da369763b4fee8d87ff9f6bf25ae3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.627931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:51.652467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 843/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:51.655407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.655827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.656687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.697055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:51.700671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.725879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 844/1675] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:51.727076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:51.744312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2da369763b4fee8d87ff9f6bf25ae3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.747884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4fd8a-91e9-4b4f-b632-82b824e5b588 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:51.760024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2da369763b4fee8d87ff9f6bf25ae3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.761098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:51.761910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.762313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.762789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.763716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:51.764144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.764671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2da369763b4fee8d87ff9f6bf25ae3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.767558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:51.780154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2da369763b4fee8d87ff9f6bf25ae3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.796856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 845/1676] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:51.798075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:51.801599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.806247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8b3d2726-b309-40aa-a5e4-55093b1047a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2da369763b4fee8d87ff9f6bf25ae3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:51.815571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 832/1677] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:51 2022] DELETE /identity/v3/users/ea2da369763b4fee8d87ff9f6bf25ae3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:51.820639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.820776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.820991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.830911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995f948-ab03-444b-992f-50451acc61a1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:51.867293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:51.871400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:51.977148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:51.978010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:51.979160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:51.979160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:51.979978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:51.982692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.038904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 846/1678] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:51 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:52.043227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.055263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 833/1679] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:52.071940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.073590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:52.178476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d5d04-e660-4187-970b-3565894ea789 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.181582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0aa8-9540-4834-86d3-fad8cedc8865 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.195323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.196172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.196553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.196927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.198336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.200592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.250936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 847/1680] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:52 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:17:52.254612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.275285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae835a-f9b6-4b50-9c3a-0d1a2c0a21ef admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.275855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.276661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.277316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.277716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.287824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.288723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.289136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.289529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.290537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.292741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.298121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.302429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.314682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 848/1681] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:52.319005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.326686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 834/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:17:52.338242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c67f-9a39-47f2-aee3-4bc4824574c5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.352198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.353151 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.353560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.354105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.355013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.360695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432672-47e6-4cc9-b4bc-d373bcad6622 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.385747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 849/1683] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:52.390957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.407574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68205-1dac-4ef7-a83a-f107e08b0c0f service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.417669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.419806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.419806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.421399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] PATH_INFO: `/v3/projects/beae30b7ca2c41a6a4e3e40ab3455c8a/users/222ebecea6ff4bb7a02b68ea6666452a/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.481116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beae30b7ca2c41a6a4e3e40ab3455c8a, user_id=222ebecea6ff4bb7a02b68ea6666452a, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.481116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.502729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 835/1684] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:52 2022] PUT /identity/v3/projects/beae30b7ca2c41a6a4e3e40ab3455c8a/users/222ebecea6ff4bb7a02b68ea6666452a/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:52.512871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b39732-5010-47fc-9193-5121f2305735 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.513155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b39732-5010-47fc-9193-5121f2305735 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.513431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b39732-5010-47fc-9193-5121f2305735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.565195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-84b39732-5010-47fc-9193-5121f2305735 None None] MFA Rules not processed for user `222ebecea6ff4bb7a02b68ea6666452a`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:52.566633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-84b39732-5010-47fc-9193-5121f2305735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:52.719097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 850/1685] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:52.723468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.873768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de09d9-0199-4783-aae6-4a8e88b11e10 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.887640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:52.888403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:52.889800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:52.893112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:52.894660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:52.900105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:52.954451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b39732-5010-47fc-9193-5121f2305735 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:52.955939 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-84b39732-5010-47fc-9193-5121f2305735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:52.979800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b39732-5010-47fc-9193-5121f2305735 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:52.980604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 836/1686] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:52 2022] POST /identity/v3/projects => generated 363 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:52.985621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.105495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.106036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773050dd-016c-44b0-9792-02c769de72db admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.106559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.106793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.107389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] PATH_INFO: `/v3/projects/1e13752dda554900a802538d520b801f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.110072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e13752dda554900a802538d520b801f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.111246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: WARNING py.warnings [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 20 16:17:53.111246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: warnings.warn(msg) Mar 20 16:17:53.111246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: Mar 20 16:17:53.112490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.123311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.124877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.124877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.125033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.125820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.131375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.174296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 837/1687] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:52 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:53.178580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.203699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e121-7585-4f6c-b542-b2c4ad58a4e9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.236994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e13752dda554900a802538d520b801f', 'request_id': 'req-0825432d-916a-454e-872f-8cdf97d68375'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:53.247281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e13752dda554900a802538d520b801f', 'request_id': 'req-0825432d-916a-454e-872f-8cdf97d68375'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:53.266291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e13752dda554900a802538d520b801f', 'request_id': 'req-0825432d-916a-454e-872f-8cdf97d68375'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:53.306902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] The token cache is being invalidate because project 1e13752dda554900a802538d520b801f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:53.307394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:53.309126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0825432d-916a-454e-872f-8cdf97d68375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:53.313707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 851/1688] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:52 2022] DELETE /identity/v3/projects/1e13752dda554900a802538d520b801f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:53.318329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8235c-048f-4683-8fdd-b91e1b0f6d4d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.318634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8235c-048f-4683-8fdd-b91e1b0f6d4d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.319242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8235c-048f-4683-8fdd-b91e1b0f6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.325910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.327088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.328195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.328778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.330584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.334928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.360261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-92a8235c-048f-4683-8fdd-b91e1b0f6d4d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:53.361193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 838/1689] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:53.362208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.363054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-92a8235c-048f-4683-8fdd-b91e1b0f6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:53.370428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:53.383224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 852/1690] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:53.390552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.390882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.391158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.393740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61dcb-994e-4fb6-9da4-c39f4e0acbe7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.409054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.410712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.411242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.411575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] PATH_INFO: `/v3/projects/7ebf12e4e28c48898efa39218c838f9e/users/cf775c5efe434235b9e7f5139d374a0a/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.423143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:53.426640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:53.446336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 853/1691] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:53.446976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebf12e4e28c48898efa39218c838f9e, user_id=cf775c5efe434235b9e7f5139d374a0a, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.449615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.449865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.472594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbd0d-360d-4620-845f-b950fc483e34 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.482788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 839/1692] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:53 2022] PUT /identity/v3/projects/7ebf12e4e28c48898efa39218c838f9e/users/cf775c5efe434235b9e7f5139d374a0a/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:53.487883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.615481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.616532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.617012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.617505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.618578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:53.619129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.620958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.636694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 854/1693] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:53.645711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.657665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ea7a3-b152-4a2a-b0aa-4ffe9dcf615e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.666031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.667807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a135bf-d648-4e04-8716-570faa2bc0c3 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.668666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.669075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.670197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.671116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.676643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.677832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.678650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.679079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.679440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.680240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.682273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.695837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 840/1694] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:53.701057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.731956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5925a2-2af8-4f7c-9a81-cb2b3bae2b7a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.739143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 855/1695] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:53.739788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.740327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:53.741734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.742146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.742626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] PATH_INFO: `/v3/projects/7ebf12e4e28c48898efa39218c838f9e/users/cf775c5efe434235b9e7f5139d374a0a/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.744893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebf12e4e28c48898efa39218c838f9e, user_id=cf775c5efe434235b9e7f5139d374a0a, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.749296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46864-284d-4f54-846a-06ea65d06ed5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:53.779042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 841/1696] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:53 2022] PUT /identity/v3/projects/7ebf12e4e28c48898efa39218c838f9e/users/cf775c5efe434235b9e7f5139d374a0a/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:53.794773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.795279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.795733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.844878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8d51e-490a-4dee-8a52-f46e65e6eaaa admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:53.868347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] MFA Rules not processed for user `cf775c5efe434235b9e7f5139d374a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:53.869866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:53.985326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:53.987256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:53.988233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:53.989272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:53.993086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:53.997816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.022773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 842/1697] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:17:54.033443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.035127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.055246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 856/1698] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:53 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:54.060039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.083321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b619d-5f2b-4745-863a-e2c60e46aec5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.095169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.095858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.096136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.096406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.097230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.099030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.122881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 857/1699] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:17:54.127708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.143897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d87739-a75e-4662-b910-06c9c1921473 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.148285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed4818-352d-4c56-94c8-c65c5181ae90 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.157717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.158657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.159231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.162165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.162969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.163147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.163419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.164152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.165767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.171345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.186180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.192311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.193694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 858/1700] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:17:54.194912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.200739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.251911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 843/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:54.253250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.262164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c769a1a-dffe-4489-9368-67042d1954a5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.297378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.302328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.302669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.302955 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] PATH_INFO: `/v3/projects/4d7d306143f24141a45d4bed4df19c97` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.304195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e602-616d-40a2-9859-144307f8e27c service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.308145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7d306143f24141a45d4bed4df19c97)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.318436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.321518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.323648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.323939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.324789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] PATH_INFO: `/v3/projects/c0d6c1be955e44e3888b7dcae6f326e5/users/74c727ba05104c42a2e4b8075c7b3d71/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.361432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d6c1be955e44e3888b7dcae6f326e5, user_id=74c727ba05104c42a2e4b8075c7b3d71, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.366922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40529-1935-4429-8beb-5ab53c172136 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.391642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 844/1702] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:54 2022] PUT /identity/v3/projects/c0d6c1be955e44e3888b7dcae6f326e5/users/74c727ba05104c42a2e4b8075c7b3d71/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:54.413776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.414321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.415056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.452129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7d306143f24141a45d4bed4df19c97', 'request_id': 'req-f8773330-bad5-4a85-9518-59e55ceeca87'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.453094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] MFA Rules not processed for user `74c727ba05104c42a2e4b8075c7b3d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:54.455721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.468583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7d306143f24141a45d4bed4df19c97', 'request_id': 'req-f8773330-bad5-4a85-9518-59e55ceeca87'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.480264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7d306143f24141a45d4bed4df19c97', 'request_id': 'req-f8773330-bad5-4a85-9518-59e55ceeca87'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.509554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] The token cache is being invalidate because project 4d7d306143f24141a45d4bed4df19c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:54.509872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.510577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.516241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 859/1703] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:54 2022] DELETE /identity/v3/projects/4d7d306143f24141a45d4bed4df19c97 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:54.519880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.522210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.592705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 845/1704] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:54.610687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:54.612361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.675827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773330-bad5-4a85-9518-59e55ceeca87 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.690295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.691567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.692073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.692574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] PATH_INFO: `/v3/users/9f640c582a734a7aa3e40b99feb165d3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.694309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f640c582a734a7aa3e40b99feb165d3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.697301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.806637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f640c582a734a7aa3e40b99feb165d3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.828112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f640c582a734a7aa3e40b99feb165d3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.828957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f640c582a734a7aa3e40b99feb165d3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.829712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f640c582a734a7aa3e40b99feb165d3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.874360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bb904baa-0ac4-4691-9d61-20b1494eeb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f640c582a734a7aa3e40b99feb165d3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:54.917701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d410b-fb94-42c8-a0c4-1d65e161b3c7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:54.933877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 860/1705] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:54 2022] DELETE /identity/v3/users/9f640c582a734a7aa3e40b99feb165d3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:54.940430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:54.941308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.941717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.942136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:54.944531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:54.957317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:54.960152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:54.992456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:54.993529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:54.994004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.025459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 846/1706] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:17:55.045643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:55.048100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.125798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:55.127247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.153940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ea6f-4970-4fd2-8b49-0c03e53b69fd service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:55.196716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 861/1707] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:17:55.249807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:55.251033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:55.251329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:55.251626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] PATH_INFO: `/v3/users/222ebecea6ff4bb7a02b68ea6666452a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.256284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222ebecea6ff4bb7a02b68ea6666452a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:55.258245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:55.343522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222ebecea6ff4bb7a02b68ea6666452a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.360780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222ebecea6ff4bb7a02b68ea6666452a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.361783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222ebecea6ff4bb7a02b68ea6666452a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.383863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:55.386026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222ebecea6ff4bb7a02b68ea6666452a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.386240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.404891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3b17d-df16-4c07-a06c-3155b4b7fb48 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:55.411659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:55.414280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:55.415552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:55.415974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] PATH_INFO: `/v3/users/74c727ba05104c42a2e4b8075c7b3d71` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.419637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c727ba05104c42a2e4b8075c7b3d71)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:55.426741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:55.430222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-32373a58-a524-4715-a7a7-7897841ad233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222ebecea6ff4bb7a02b68ea6666452a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.448254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 847/1708] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:55 2022] DELETE /identity/v3/users/222ebecea6ff4bb7a02b68ea6666452a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:55.453376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd140-6e4a-48e7-ac98-5fa353e2d651 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:55.453881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd140-6e4a-48e7-ac98-5fa353e2d651 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:55.454291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd140-6e4a-48e7-ac98-5fa353e2d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.495527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-528fd140-6e4a-48e7-ac98-5fa353e2d651 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:55.497910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-528fd140-6e4a-48e7-ac98-5fa353e2d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.535668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c727ba05104c42a2e4b8075c7b3d71'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.548697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c727ba05104c42a2e4b8075c7b3d71'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.549652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c727ba05104c42a2e4b8075c7b3d71'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.550961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c727ba05104c42a2e4b8075c7b3d71'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.570523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c727ba05104c42a2e4b8075c7b3d71'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:55.588791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 862/1709] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:55 2022] DELETE /identity/v3/users/74c727ba05104c42a2e4b8075c7b3d71 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:17:55.601692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:55.608108 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.681204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 848/1710] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:55.681204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:55.681204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:55.681204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.731177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:55.732611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.793657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f084-4c68-41fa-9948-8872118a2895 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:55.812129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:55.814722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:55.815010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:55.815288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:55.832971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:55.865408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 849/1711] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:55.866304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:55.870202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:56.032267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:56.035393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:56.070394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 863/1712] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:17:56.073424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:56.081317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:56.125048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1159f-d5e0-411a-a423-f91d799f2f32 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:56.127181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7bb20-4671-463d-be4b-21e781f5c3fc service swift] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:56.153588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:56.154520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:56.155052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:56.157539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:56.163394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:56.167737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:56.168019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:56.169593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:56.181601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:56.183341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c92b3-7dd7-45b4-a2ab-ffadb86d2ea3 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:56.198321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:56.199928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f6c4e-27e9-4491-a46c-61ffd84c3b6c service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:56.237838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 850/1713] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:56.238175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 864/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:57.135655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:57.136043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:57.136417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:57.206953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] MFA Rules not processed for user `eb902201a42144e190a4237f4e568adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:57.208494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:57.395707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 851/1715] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:57.406769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:57.411536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:57.412098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:57.441921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] MFA Rules not processed for user `eb902201a42144e190a4237f4e568adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:57.453049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:57.471177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 865/1716] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:57.490793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:57.492290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:57.552642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:57.555878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:57.623056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f249e49-671b-4b6a-80d0-9b875bdfeb2b None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:57.642989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:57.643890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:57.644173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:57.644450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] PATH_INFO: `/v3/projects/e8efd55994c94bef8b6352c38933e8ec` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:57.652645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8efd55994c94bef8b6352c38933e8ec)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:57.661691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a968c-46ec-46a6-865f-a56a221598a0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:57.680767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:57.693260 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:57.702117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:57.704272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:57.707743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:57.734022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:57.736215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b915f5-fd19-4129-ab99-3db6e7840178 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:57.751675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 852/1717] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:57.842125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8efd55994c94bef8b6352c38933e8ec', 'request_id': 'req-02c993d4-257d-4bea-9837-c448d41953f7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:57.859624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8efd55994c94bef8b6352c38933e8ec', 'request_id': 'req-02c993d4-257d-4bea-9837-c448d41953f7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:57.890491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8efd55994c94bef8b6352c38933e8ec', 'request_id': 'req-02c993d4-257d-4bea-9837-c448d41953f7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:57.912068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] The token cache is being invalidate because project e8efd55994c94bef8b6352c38933e8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:57.912727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:57.914163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-02c993d4-257d-4bea-9837-c448d41953f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:57.916972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 866/1718] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:57 2022] DELETE /identity/v3/projects/e8efd55994c94bef8b6352c38933e8ec => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:17:57.922244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:57.923548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:57.924677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:57.952626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:57.954314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:58.053420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 853/1719] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:58.062216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.062802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.063409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.123595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:58.124805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:58.147838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 867/1720] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:17:58.152272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.187288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6eee0-eef0-461b-aef9-2097c1e216e1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.197778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.198968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.199397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.199810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.202180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:17:58.202739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.204531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.223930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 854/1721] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:17:58.225534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.239301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f2501-319c-4d1f-b159-96c418c89d54 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.255950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.256959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.257428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.257874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.259240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.261459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.332545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.343517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 868/1722] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:58 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:58.344783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036ec4-0f94-492c-b236-9be7e84fe0ad admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.446218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.447194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.452481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.453027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.479084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.484281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.552961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.566317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 855/1723] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:58 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:58.568258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dfd8d-470c-419b-be35-7b90cdcd8b86 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.574102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.575345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.575852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.576376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.577589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.580171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.612637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.613840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 869/1724] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:17:58.645465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d870-ffd3-4ad1-acff-345fae661111 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.654414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.655514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.656013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.656498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.658207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.660779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9586220-0438-4fe9-9c70-fd1c143036a3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.678788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:58.706955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 856/1725] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:17:58.708236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2654a-23bb-4793-8065-24e52c4b449a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:58.713707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:58.714795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.715309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.715706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] PATH_INFO: `/v3/projects/4fd8250cafc04cc7924a54a062016ef6/users/996b58947b9e4ff38e96e9dd54a96cc2/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.763621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd8250cafc04cc7924a54a062016ef6, user_id=996b58947b9e4ff38e96e9dd54a96cc2, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:58.770086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:58.794235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 870/1726] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:17:58 2022] PUT /identity/v3/projects/4fd8250cafc04cc7924a54a062016ef6/users/996b58947b9e4ff38e96e9dd54a96cc2/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:58.805633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:58.805950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:58.806874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:58.852498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] MFA Rules not processed for user `996b58947b9e4ff38e96e9dd54a96cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:58.854025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.007756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 857/1727] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:59.013981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.035059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.047539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.198785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9831ad-d47b-48e6-9c13-eb8fa1f195c7 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.214390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:59.216462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.216743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.217017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.217729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:59.221062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:59.230319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ea72-85aa-4608-b4f2-378ea75d15a9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.242031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:59.242970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.243245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.243516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] PATH_INFO: `/v3/users/55d5039dd3c24e6fb599040a9f22083a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.245333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d5039dd3c24e6fb599040a9f22083a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:59.247753 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:59.286965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 871/1728] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:17:59 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:17:59.292048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.340978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d5039dd3c24e6fb599040a9f22083a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.356999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d5039dd3c24e6fb599040a9f22083a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.357964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d5039dd3c24e6fb599040a9f22083a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.368962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d5039dd3c24e6fb599040a9f22083a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.395580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-fca041aa-92dc-42b9-b203-4f07d70a2299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d5039dd3c24e6fb599040a9f22083a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.403161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 858/1729] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:17:59 2022] DELETE /identity/v3/users/55d5039dd3c24e6fb599040a9f22083a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:59.410820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d858-4e34-44dd-9f83-27a4264f39cf None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.411266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d858-4e34-44dd-9f83-27a4264f39cf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.420719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d858-4e34-44dd-9f83-27a4264f39cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.450051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3b30d858-4e34-44dd-9f83-27a4264f39cf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:59.452710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3b30d858-4e34-44dd-9f83-27a4264f39cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.461813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d568-49ed-4e91-becf-41f5e3ffd02a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.571237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 859/1730] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:17:59.573646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.573981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.574291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.617979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:59.620423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.621422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.621968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.623040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:59.626042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:59.630047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:17:59.631327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.667914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 872/1731] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:17:59 2022] POST /identity/v3/users => generated 299 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:17:59.669222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.671387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.703125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7fa51-a448-4c77-959c-aacc8e2d7086 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.709624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:59.710759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.711234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.712429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] PATH_INFO: `/v3/projects/beae30b7ca2c41a6a4e3e40ab3455c8a` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.715599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beae30b7ca2c41a6a4e3e40ab3455c8a)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:59.718929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:59.728340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 860/1732] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Mar 20 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:17:59.729560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.731517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.752384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bbb9-abe8-4381-940c-344fffb771e7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.757052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:17:59.758209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:17:59.758209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:17:59.758659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:17:59.778049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:17:59.781171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:17:59.819848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 861/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:17:59.822213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.828776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:17:59.843597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beae30b7ca2c41a6a4e3e40ab3455c8a', 'request_id': 'req-22fd55f8-4bf5-45dd-bee0-409543b15b84'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.856480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beae30b7ca2c41a6a4e3e40ab3455c8a', 'request_id': 'req-22fd55f8-4bf5-45dd-bee0-409543b15b84'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.861808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56764f3-43fd-4912-8569-10d76e90d5e7 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:17:59.876603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beae30b7ca2c41a6a4e3e40ab3455c8a', 'request_id': 'req-22fd55f8-4bf5-45dd-bee0-409543b15b84'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.912542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] The token cache is being invalidate because project beae30b7ca2c41a6a4e3e40ab3455c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:17:59.914446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.915638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:17:59.920306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 873/1734] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:17:59 2022] DELETE /identity/v3/projects/beae30b7ca2c41a6a4e3e40ab3455c8a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:17:59.924480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:17:59.929549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.018465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.019641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.020098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.020585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.021595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.029280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.072638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 862/1735] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:00.076221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:00.079992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd55f8-4bf5-45dd-bee0-409543b15b84 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:00.083767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.089908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.092377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.093045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.093858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.105539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.125019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087413ef-d715-45fc-9185-966c4403f990 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:00.132156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.135510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.160787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 874/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:00.164257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:00.168192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.169422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.170634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.171128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.171619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] PATH_INFO: `/v3/users/cf775c5efe434235b9e7f5139d374a0a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.173671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf775c5efe434235b9e7f5139d374a0a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.177502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.223128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281180-8b07-4433-a96f-959dfabd2c5d service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:00.234674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.235852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.236194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.236530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] PATH_INFO: `/v3/projects/e48beb7e571c40e6b1fb516367900280/users/12a38a45f40346e6b250ae4c8a3c30d3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.282554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48beb7e571c40e6b1fb516367900280, user_id=12a38a45f40346e6b250ae4c8a3c30d3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.285948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191024-f698-47e6-9cc8-b60aee4aea87 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.291329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf775c5efe434235b9e7f5139d374a0a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.325351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 875/1737] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:00 2022] PUT /identity/v3/projects/e48beb7e571c40e6b1fb516367900280/users/12a38a45f40346e6b250ae4c8a3c30d3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:00.326600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf775c5efe434235b9e7f5139d374a0a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.326866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.327158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.327436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.330058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf775c5efe434235b9e7f5139d374a0a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.346219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf775c5efe434235b9e7f5139d374a0a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.381658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf775c5efe434235b9e7f5139d374a0a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.398535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 863/1738] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:00 2022] DELETE /identity/v3/users/cf775c5efe434235b9e7f5139d374a0a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:00.402242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:00.407373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.432265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] MFA Rules not processed for user `8fe6db1f6d934ba0bd95826e6c76c556`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:00.436095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.592212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 876/1739] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:00.593638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:00.599227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.664349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b312f-f246-4781-a8c8-1959d6c05e6f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:00.696742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.697453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.697729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.697998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.698766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.703074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c4d95-f6e1-4f19-94b0-8f2b5d317658 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.758418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 864/1740] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:00.763266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf08e-4b2e-40d1-9d4e-cbdacca7e162 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.763266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf08e-4b2e-40d1-9d4e-cbdacca7e162 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.763266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cf08e-4b2e-40d1-9d4e-cbdacca7e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.783245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5be3e-0bdd-4c6b-95fb-09f5e62d9186 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:00.799887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:00.801753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:00.802501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:00.803008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] PATH_INFO: `/v3/projects/c0d6c1be955e44e3888b7dcae6f326e5` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:00.806038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d6c1be955e44e3888b7dcae6f326e5)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:00.808454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:00.826037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7f7cf08e-4b2e-40d1-9d4e-cbdacca7e162 None None] MFA Rules not processed for user `e69d0561fe714fab9b7171faf257742c`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:00.827291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7f7cf08e-4b2e-40d1-9d4e-cbdacca7e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:00.917096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d6c1be955e44e3888b7dcae6f326e5', 'request_id': 'req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.937961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d6c1be955e44e3888b7dcae6f326e5', 'request_id': 'req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.956720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d6c1be955e44e3888b7dcae6f326e5', 'request_id': 'req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.979443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] The token cache is being invalidate because project c0d6c1be955e44e3888b7dcae6f326e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:00.980472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.982373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:00.986666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 877/1741] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:00 2022] DELETE /identity/v3/projects/c0d6c1be955e44e3888b7dcae6f326e5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:00.988121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:00.993112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.019468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 865/1742] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:01.021000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.025506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.026488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.068360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:01.069976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.162123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661b2d-e180-4f5d-87b1-1aab1e8f027d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:01.173708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:01.176034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.176402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.177357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] PATH_INFO: `/v3/projects/e48beb7e571c40e6b1fb516367900280/users/12a38a45f40346e6b250ae4c8a3c30d3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.183135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48beb7e571c40e6b1fb516367900280, user_id=12a38a45f40346e6b250ae4c8a3c30d3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:01.186044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:01.211397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 878/1743] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:00 2022] PUT /identity/v3/projects/e48beb7e571c40e6b1fb516367900280/users/12a38a45f40346e6b250ae4c8a3c30d3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:01.216567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:01.232712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.235903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 866/1744] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:01.243225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:01.244769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.273449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc05b14-ba69-4d74-a663-61dfe24dd0e8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:01.329054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5bf0f-8d75-4033-a869-dfddd9e980d3 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:01.335666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:01.336683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.336992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.337511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] PATH_INFO: `/v3/projects/7ebf12e4e28c48898efa39218c838f9e` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.338876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebf12e4e28c48898efa39218c838f9e)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:01.341034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:01.405500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebf12e4e28c48898efa39218c838f9e', 'request_id': 'req-3ed1c611-484f-40af-9c4d-7e8d8c952f22'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.412382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebf12e4e28c48898efa39218c838f9e', 'request_id': 'req-3ed1c611-484f-40af-9c4d-7e8d8c952f22'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.425317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebf12e4e28c48898efa39218c838f9e', 'request_id': 'req-3ed1c611-484f-40af-9c4d-7e8d8c952f22'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.436130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:01.437447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.437831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.438166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] PATH_INFO: `/v3/projects/0f94912f17654e538c0c2c0800da01af` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.439529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f94912f17654e538c0c2c0800da01af)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:01.445278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:01.474682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] The token cache is being invalidate because project 7ebf12e4e28c48898efa39218c838f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:01.478125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.479743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.487034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 879/1745] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:01 2022] DELETE /identity/v3/projects/7ebf12e4e28c48898efa39218c838f9e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:01.487034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:01.493244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.558238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f94912f17654e538c0c2c0800da01af', 'request_id': 'req-e03137ce-de08-475c-b8bb-b551ad6c6caa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.569995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f94912f17654e538c0c2c0800da01af', 'request_id': 'req-e03137ce-de08-475c-b8bb-b551ad6c6caa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.600932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f94912f17654e538c0c2c0800da01af', 'request_id': 'req-e03137ce-de08-475c-b8bb-b551ad6c6caa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.638370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] The token cache is being invalidate because project 0f94912f17654e538c0c2c0800da01af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:01.638370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.640725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e03137ce-de08-475c-b8bb-b551ad6c6caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:01.645879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 867/1746] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:01 2022] DELETE /identity/v3/projects/0f94912f17654e538c0c2c0800da01af => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:01.651345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3aaf-b5f6-43c0-ae8c-7f5f9b0f876b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.651638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3aaf-b5f6-43c0-ae8c-7f5f9b0f876b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.651913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3aaf-b5f6-43c0-ae8c-7f5f9b0f876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.692454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c611-484f-40af-9c4d-7e8d8c952f22 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:01.743316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ad8d3aaf-b5f6-43c0-ae8c-7f5f9b0f876b None None] MFA Rules not processed for user `12a38a45f40346e6b250ae4c8a3c30d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:01.744592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ad8d3aaf-b5f6-43c0-ae8c-7f5f9b0f876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.889307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:01.890046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.890479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.890850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.896787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:01.949032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 868/1747] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:01.951289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:01.951809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:01.952286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:01.997513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:02.007942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.067210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:02.069161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad663c-a7d6-4d17-b151-b0bac943f419 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:02.079824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 880/1748] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:02.081212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.081605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.081972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.123299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:02.124885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.189992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 869/1749] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:02.190919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:02.193909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.241637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295f6ec-8b29-427e-8ad0-0d4a9d1ad624 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:02.254303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:02.255186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.256886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.257751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.273248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.287425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 881/1750] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:02.290426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:02.305301 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.337487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70167b-6053-4cca-a10e-aee68a54dc99 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:02.349665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:02.349665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.349665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.349665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] PATH_INFO: `/v3/users/82241200ed604d2e96c7404477014a85` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.352041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82241200ed604d2e96c7404477014a85)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:02.354520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:02.435260 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:02.442889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:02.473529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82241200ed604d2e96c7404477014a85'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:02.479397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 870/1751] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:02.481655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:02.485381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.498933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82241200ed604d2e96c7404477014a85'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:02.500886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82241200ed604d2e96c7404477014a85'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:02.501847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82241200ed604d2e96c7404477014a85'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:02.557612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82241200ed604d2e96c7404477014a85'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:02.594002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 882/1752] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:02 2022] DELETE /identity/v3/users/82241200ed604d2e96c7404477014a85 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:02.595276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:02.602907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.715937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f30e5-7957-4f46-a1e5-e775199d7326 service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:02.864792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d810a-2c94-45ec-a443-fe90ac0957e9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:02.873661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:02.875489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.876287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.877454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.879911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:02.880414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:02.887573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc7f75-8dd3-4097-a09e-628fe8845568 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:02.899258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:02.907570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.908044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.908422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.925706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:02.949614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 883/1753] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:02.953444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:02.955285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:02.955724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:02.989291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:02.991732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:03.006454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 884/1754] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:03.006454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.019881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edafe4-c575-474b-95a5-26306653e403 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:03.026935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:03.027727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.031435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.032097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.032859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.035837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.096701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 885/1755] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:03 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:03.096701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.132987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.135480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd575d4-435e-489c-9d33-16b91be37734 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.172271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 871/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:03.176020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda63fa-829d-4849-99c2-f937c45eb184 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.180924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda63fa-829d-4849-99c2-f937c45eb184 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.185318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda63fa-829d-4849-99c2-f937c45eb184 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.193334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 872/1757] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:18:03 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:18:03.209649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda63fa-829d-4849-99c2-f937c45eb184 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.345811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b525e9-0717-4167-8902-8fdc69d87e1d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:03.390014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:03.393336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.394374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda63fa-829d-4849-99c2-f937c45eb184 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:03.399081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.399462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.400264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:03.400578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.402225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.404238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:03.405200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.405566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.405927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.406772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.408751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c068-95fc-4f85-8c7b-66546eb09605 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.474859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 886/1758] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:03.475020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.486043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 873/1759] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:03 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:03.488335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.492576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.492981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.501350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:03.536008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba917398-c8b3-43e0-ad20-09f77de57819 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:03.537305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:03.538657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:03.563716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:03.564628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.567995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.568410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] PATH_INFO: `/v3/users/996b58947b9e4ff38e96e9dd54a96cc2` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.573457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996b58947b9e4ff38e96e9dd54a96cc2)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.580622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.713818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 874/1760] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:03.715190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.724176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:03.750692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707b495-70f7-4370-8aa7-8137ad74a12c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:03.756414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:03.757538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:03.757917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:03.758369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] PATH_INFO: `/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:03.759706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52eeb450bf14ca7aaa60a7822bd9275)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:03.761910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:03.796359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996b58947b9e4ff38e96e9dd54a96cc2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.826894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996b58947b9e4ff38e96e9dd54a96cc2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.829951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996b58947b9e4ff38e96e9dd54a96cc2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.833189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996b58947b9e4ff38e96e9dd54a96cc2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.851313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996b58947b9e4ff38e96e9dd54a96cc2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.857982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52eeb450bf14ca7aaa60a7822bd9275', 'request_id': 'req-335e5405-1ca9-4279-87f5-859c216dd042'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.870173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52eeb450bf14ca7aaa60a7822bd9275', 'request_id': 'req-335e5405-1ca9-4279-87f5-859c216dd042'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.887261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52eeb450bf14ca7aaa60a7822bd9275', 'request_id': 'req-335e5405-1ca9-4279-87f5-859c216dd042'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.899205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 887/1761] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:03 2022] DELETE /identity/v3/users/996b58947b9e4ff38e96e9dd54a96cc2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:03.900553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.909438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:03.919034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] The token cache is being invalidate because project d52eeb450bf14ca7aaa60a7822bd9275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:03.922673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.926303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:03.932232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 875/1762] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:03 2022] DELETE /identity/v3/projects/d52eeb450bf14ca7aaa60a7822bd9275 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:03.932232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:03.937381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.150097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f5784-f43d-4263-80ed-1fce4f08a510 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:04.165949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:04.166684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.167013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.167345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.167936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:04.169877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8a4d-ee25-45db-8ca9-96a43552ff2b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:04.182894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5405-1ca9-4279-87f5-859c216dd042 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:04.223313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:04.224098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.224439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.225723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.226644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:04.230207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5e108-f8af-4641-b142-91b0b3c02986 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:04.247847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 876/1763] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:04.249692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d652ee-c9eb-45b3-981a-76baa6f897c3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.250126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d652ee-c9eb-45b3-981a-76baa6f897c3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.250883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d652ee-c9eb-45b3-981a-76baa6f897c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.265153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 888/1764] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:03 2022] POST /identity/v3/projects => generated 369 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:04.281013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.281753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.281753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.302867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-12d652ee-c9eb-45b3-981a-76baa6f897c3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:04.307894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-12d652ee-c9eb-45b3-981a-76baa6f897c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.342294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:04.343851 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.479557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 877/1765] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:04.484099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.484490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.486196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.528207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] MFA Rules not processed for user `eb902201a42144e190a4237f4e568adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:04.530711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.537459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 889/1766] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:04.538602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:04.542396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.701210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 878/1767] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:04.702216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:04.730746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f628-4d13-4524-92b2-eb84d699d6c4 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:04.753643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b594571-24cb-46e2-ab25-6edf7421fdf9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:04.766226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:04.767049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.767429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.767811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.768648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:04.775931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:04.800276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:04.804452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.809259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.810041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.822193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.837002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 879/1768] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:04.844477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:04.846680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:04.866735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c4af2-6ac3-4336-ae56-aaf7ec89645b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:04.875404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:04.883342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7a126-547c-4ed0-8d39-ffd5c083bb73 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:04.887859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:04.889490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.907651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.909270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.910550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:04.916195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:04.935391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 890/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:04.943729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:04.944026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:04.946513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:04.989669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 880/1770] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:04 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:04.991981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:04.997488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:05.018762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:05.020948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:05.076452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 891/1771] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:05.078736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.125481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812e98-3c5c-428f-9af1-0aabd93dff6d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.145424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.153071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.153749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.153926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] PATH_INFO: `/v3/projects/22613a0359224b36b9cdb32be35169bb/users/15c85a1543764641a9da2536b74fbfcc/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.218386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22613a0359224b36b9cdb32be35169bb, user_id=15c85a1543764641a9da2536b74fbfcc, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.223179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.242230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef040b-ee76-4334-905a-5b1f6e9b00b0 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.251320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.253175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.254100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.254423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.258691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 892/1772] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:05 2022] PUT /identity/v3/projects/22613a0359224b36b9cdb32be35169bb/users/15c85a1543764641a9da2536b74fbfcc/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:05.260773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.291075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.296903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.321780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 881/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:05.322700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.344016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15abbcd-3920-48fc-a46e-f1b0595992ee service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.475361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c3d71-10f8-4f60-9661-55b036f27e07 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.498419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.499715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.507903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.508595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.508897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.509176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.509958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:05.510278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.518780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.518942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.520018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.521010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.524113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6aa3-ef4a-465d-828b-f07f21df8647 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.549725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 893/1774] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:05.551168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.551458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.551733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.588698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 882/1775] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:05.589713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.626325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166389d-a80a-4ff3-b80f-da8d6f3c26a9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.636884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.637928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.638407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.638917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.639901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.641032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] MFA Rules not processed for user `15c85a1543764641a9da2536b74fbfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:05.642292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:05.643682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.674193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 883/1776] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:05.675350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.706404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095519c0-47e0-41b8-9c21-40d30c00675a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:05.722157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:05.724644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:05.725722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:05.726385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:05.728911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:05.734664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:05.856384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 884/1777] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:05 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:05.857566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.888621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 894/1778] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:05.892135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:05.920471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f7758-d19a-4fe0-91de-168fa01e4fd0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.080409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2179-244d-4157-aef1-82ad84f1a9f4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.097308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.100481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.100893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.103452 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] PATH_INFO: `/v3/projects/db99e2f7e1454da48e71dba38695b18f/users/d8fddcff5e9e46f2a984298e20e49ef8/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.105375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.106102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.106467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.106960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.107669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.109716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.148386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db99e2f7e1454da48e71dba38695b18f, user_id=d8fddcff5e9e46f2a984298e20e49ef8, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.156123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.162486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 895/1779] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:05 2022] POST /identity/v3/users => generated 305 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:06.163365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.183943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 885/1780] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:05 2022] PUT /identity/v3/projects/db99e2f7e1454da48e71dba38695b18f/users/d8fddcff5e9e46f2a984298e20e49ef8/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:06.185047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.187353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1913-5f80-4d5d-8134-7cf69571e741 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.481557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea916-0549-458f-856c-d755c494b0f7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.482532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.483465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.483849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.484224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.485739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.487800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.500586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.501412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.501797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.502171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.503283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.507807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f6a7-87f1-4914-8d75-905d8a072918 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.535626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 886/1781] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:06.542384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.545377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.546139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.549681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 896/1782] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:06 2022] POST /identity/v3/projects => generated 363 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:06.553406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.640932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] MFA Rules not processed for user `d8fddcff5e9e46f2a984298e20e49ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:06.642286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:06.800435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420dcb-f492-4883-91f1-d2acf852ab9d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.821371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.822423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.822923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.823407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.824464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.835196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.863164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 897/1783] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:06.865211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.894324 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 887/1784] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:06.895435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.896315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4c1a-a77c-41f7-ad3b-4ab26656a6ed admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.915256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.916348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.916760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.917280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.919503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.925464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.927712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbce9e-5287-483f-9520-92a6869b49a1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:06.942045 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:06.943090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:06.943295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:06.943556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] PATH_INFO: `/v3/projects/a0f40b7d9c8e46f784c78e588c4c4e6d/users/a46efc847772456b99bd4d3bf454af45/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:06.968774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 898/1785] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:06 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:06.969709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:06.983895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f40b7d9c8e46f784c78e588c4c4e6d, user_id=a46efc847772456b99bd4d3bf454af45, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:06.987147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:06.996546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abed8d-641a-482d-8741-d7afb29d6f7f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.008320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 888/1786] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:06 2022] PUT /identity/v3/projects/a0f40b7d9c8e46f784c78e588c4c4e6d/users/a46efc847772456b99bd4d3bf454af45/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:07.009500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.009908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.010729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.010861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.011131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.011827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.013840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c8f3-d1b1-4e25-a241-a611b6d0d9ff admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.086066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 899/1787] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:06 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:07.087387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.087673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.087949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.176803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] MFA Rules not processed for user `a46efc847772456b99bd4d3bf454af45`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:07.178435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:07.181513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63729fda-5aff-4e32-a8a1-f9b4edbb0246 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.337572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 900/1788] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:07.338438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.445569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.446667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.447110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.447540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.449173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.451072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.476127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 889/1789] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:07.484729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.506543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514abf-6459-426a-9054-e1d7bd390a80 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.515650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.516329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.516665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.516949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.517868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.519868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9771f60-c980-4e55-a499-8b00bf089b05 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.525809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446befac-8b2a-426d-a944-a664432c4ac3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.531983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.532901 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.533339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.534580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.535654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.538812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.582689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 901/1790] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:07 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:07.583329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 890/1791] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:07 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:07.584619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.584822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064609-d34d-4d8f-be56-d3524c6d90ba None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.585074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064609-d34d-4d8f-be56-d3524c6d90ba None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.585363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064609-d34d-4d8f-be56-d3524c6d90ba None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.590871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 891/1792] 10.222.0.18 () {54 vars in 912 bytes} [Sun Mar 20 16:18:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:18:07.591604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064609-d34d-4d8f-be56-d3524c6d90ba None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.602066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bfedb-c587-4879-be30-f4012a67405c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.690675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.691927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.692213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.692487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] PATH_INFO: `/v3/projects/cfeb44630ed2458393fa78cab98772e7/users/02e69a1c69cd40848f51eabbecf54089/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.710830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeb44630ed2458393fa78cab98772e7, user_id=02e69a1c69cd40848f51eabbecf54089, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.713968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.735542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 902/1793] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:07 2022] PUT /identity/v3/projects/cfeb44630ed2458393fa78cab98772e7/users/02e69a1c69cd40848f51eabbecf54089/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:07.736477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.743173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064609-d34d-4d8f-be56-d3524c6d90ba None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.859442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53b0a-c87f-4ccf-bd9d-8bd37cadf7dd admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.871597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.872380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.872650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.872921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.873717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.875597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98842238-2e61-4574-bfff-71564b6e29d0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.878433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.879170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.879465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.880332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.881045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.883042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.905429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 892/1794] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:07.905797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.908541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.908688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.927707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 903/1795] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:07 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:07.928256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:07.948274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82e10-e076-4b86-9f77-0f4dbd933b0b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:07.949921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:07.951568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:07.959856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:07.960571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:07.960906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:07.961127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:07.964124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:07.965924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:07.998928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 904/1796] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:07.999983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.021633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b0250-3eb7-4710-859e-26a66b74710a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.036376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.037273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.037557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.038035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] PATH_INFO: `/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53/users/937b4865a19f4e7b9e8d3d18856dba83/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.088402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 893/1797] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:08.089634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.092416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aafebe8fcc24adb9fcfdb28c2113d53, user_id=937b4865a19f4e7b9e8d3d18856dba83, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.095706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.119961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06085638-f741-4bde-ba34-11e4f915a318 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.127624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 905/1798] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:07 2022] PUT /identity/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53/users/937b4865a19f4e7b9e8d3d18856dba83/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:08.142964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.201843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.202844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.203826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.204323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.205449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.207468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.221626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 894/1799] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:08.222820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.237633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbbf9-4cc1-4e0b-9bcc-55d259f6cbdb admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.255985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.257642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.258678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.259309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.260272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.263091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.286506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 895/1800] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:08.288095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.300778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051fdd-0651-4bda-8ac0-54738a5c05d6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.318501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.322455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.322833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.323188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] PATH_INFO: `/v3/projects/16715d595c0a46478ad59704e58aa453/users/346e3607a0fd49afa05516b9e7af11fa/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.343643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16715d595c0a46478ad59704e58aa453, user_id=346e3607a0fd49afa05516b9e7af11fa, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.346505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.370086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2316-236d-4c0f-99c9-3c50d3bad427 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.379823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 896/1801] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:08 2022] PUT /identity/v3/projects/16715d595c0a46478ad59704e58aa453/users/346e3607a0fd49afa05516b9e7af11fa/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:08.381693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.386221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:08.515918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.519042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.519369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.519874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] PATH_INFO: `/v3/projects/cfeb44630ed2458393fa78cab98772e7/users/02e69a1c69cd40848f51eabbecf54089/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.526175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeb44630ed2458393fa78cab98772e7, user_id=02e69a1c69cd40848f51eabbecf54089, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.534378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.573295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 906/1802] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:08 2022] PUT /identity/v3/projects/cfeb44630ed2458393fa78cab98772e7/users/02e69a1c69cd40848f51eabbecf54089/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:08.574021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.595962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b558e5-c3de-47d1-84fc-02ecb94e1ea0 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.657905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf7d-40ad-43c5-bcf2-6ec57f2074ea admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.662680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.664391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.664961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.665480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.688579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.690801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.701405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 907/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:08.702703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.750972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.751672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.752128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.753429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] PATH_INFO: `/v3/projects/4fd8250cafc04cc7924a54a062016ef6` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.755076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd8250cafc04cc7924a54a062016ef6)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.759375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.785516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddb1c-a2ff-4e78-890b-552ecf48ac0b service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.794019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:08.796100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:08.796943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:08.798460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] PATH_INFO: `/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53/users/937b4865a19f4e7b9e8d3d18856dba83/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:08.801284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aafebe8fcc24adb9fcfdb28c2113d53, user_id=937b4865a19f4e7b9e8d3d18856dba83, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:08.804755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:08.826013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 908/1804] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:08 2022] PUT /identity/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53/users/937b4865a19f4e7b9e8d3d18856dba83/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:08.827531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:08.894787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd8250cafc04cc7924a54a062016ef6', 'request_id': 'req-eadf038f-907f-494e-b98a-526015d8e142'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:08.918982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd8250cafc04cc7924a54a062016ef6', 'request_id': 'req-eadf038f-907f-494e-b98a-526015d8e142'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:08.945083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd8250cafc04cc7924a54a062016ef6', 'request_id': 'req-eadf038f-907f-494e-b98a-526015d8e142'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:08.959615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12378d-b362-405b-8ede-8322ecb5e419 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:08.997448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] The token cache is being invalidate because project 4fd8250cafc04cc7924a54a062016ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:08.997809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:08.999310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eadf038f-907f-494e-b98a-526015d8e142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.009484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 897/1805] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:08 2022] DELETE /identity/v3/projects/4fd8250cafc04cc7924a54a062016ef6 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:09.011466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.011466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.012085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.099626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:09.102160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.103705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] MFA Rules not processed for user `02e69a1c69cd40848f51eabbecf54089`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:09.104690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.105221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.105751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.107746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:09.113374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cc341-b7af-4537-816a-4e7080a5b8c5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:09.154755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 909/1806] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:09.156503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.156991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.157607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.224958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] MFA Rules not processed for user `937b4865a19f4e7b9e8d3d18856dba83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:09.226544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.280862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 898/1807] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:09.281998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:09.289430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.345895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca7dcc-1399-4b0a-bc37-865f8b29ffe0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:09.359687 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:09.360557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.360816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.362176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] PATH_INFO: `/v3/users/12a38a45f40346e6b250ae4c8a3c30d3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.366395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a38a45f40346e6b250ae4c8a3c30d3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:09.368372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:09.441944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 910/1808] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:09.443608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:09.449234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.471880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a13e0b-651f-4106-9bc1-0a67ea6e4b58 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:09.492281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:09.493208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.493483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.493752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] PATH_INFO: `/v3/projects/16715d595c0a46478ad59704e58aa453/users/346e3607a0fd49afa05516b9e7af11fa/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.497731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a38a45f40346e6b250ae4c8a3c30d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.500481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16715d595c0a46478ad59704e58aa453, user_id=346e3607a0fd49afa05516b9e7af11fa, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:09.507303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:09.512175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a38a45f40346e6b250ae4c8a3c30d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.513450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a38a45f40346e6b250ae4c8a3c30d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.530285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a38a45f40346e6b250ae4c8a3c30d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.547765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 911/1809] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:09 2022] PUT /identity/v3/projects/16715d595c0a46478ad59704e58aa453/users/346e3607a0fd49afa05516b9e7af11fa/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:09.548817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:09.555714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.558675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a38a45f40346e6b250ae4c8a3c30d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:09.569834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 899/1810] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:09 2022] DELETE /identity/v3/users/12a38a45f40346e6b250ae4c8a3c30d3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:09.570888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:09.573750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.670416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed4acf-51e8-4fae-b5e9-e613ef77e475 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:09.676687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:09.677552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.677855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.678112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.679853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493d0fb-e47c-4d3e-95b6-cac501a83a5a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:09.681612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.686759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:09.687438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.687730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.688025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.693088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:09.874682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:09.881308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d554eb5-67dd-463f-8c6a-15252ea5c39a service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:09.909950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 900/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:09.926502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:09.928333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:09.928630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:09.939332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:09.942796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:09.971214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 912/1812] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:10.004997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] MFA Rules not processed for user `346e3607a0fd49afa05516b9e7af11fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:10.009206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:10.036384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:10.070098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d49b-26fc-4cc2-9cda-e9cc8cd1527b service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:10.092132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:10.092817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:10.093097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:10.093588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:10.099379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:10.176559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 901/1813] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:10.269720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:10.282556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:10.284118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:10.288788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fdcb5-bfdf-4b0d-9812-6f1bb62f47f1 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:10.307413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 913/1814] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:10.320194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:10.322991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:10.331022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:10.331685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:10.356751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:10.359418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:10.429613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 902/1815] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:10.575416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:10.590316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22b7f-ae5e-42dc-8319-59a59c4e7974 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:10.598365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:10.600377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:10.600661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:10.602200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:10.606208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:10.735035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:10.736491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed737a-b64a-41c9-9bfc-2277111627d1 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:10.772376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 914/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:11.334278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:11.345148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c59e-a4d8-4c57-837e-2abe527ef94a service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:11.350212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:11.351577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:11.352026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:11.352604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:11.355484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:11.480187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:11.482008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3eadd-35ca-41df-be27-a55d14626d40 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:11.515256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 903/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:11.815359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d75c-b4ac-4046-9539-40eb74786ee4 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:11.815865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d75c-b4ac-4046-9539-40eb74786ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:11.816050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d75c-b4ac-4046-9539-40eb74786ee4 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:11.818229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 915/1818] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:18:11.869868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:11.870904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:11.871680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:11.886601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:11.886975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:11.888822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:11.923361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:11.927265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:11.931415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] MFA Rules not processed for user `e69d0561fe714fab9b7171faf257742c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:11.933219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:12.014216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 916/1819] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:12.134452 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 904/1820] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:12.154553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:12.158097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:12.213265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199ffb-ec87-446d-814f-858de27e5906 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:12.234185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:12.234185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:12.234526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:12.234792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:12.248445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:12.260055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f582d5-5861-464c-bc36-1ca1eda5a78d service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:12.279934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 917/1821] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:12.729357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:12.730896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:12.869836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d616e31-cda3-4351-92af-da1ae96ca12d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:12.884059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:12.885623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:12.886691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:12.889166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] PATH_INFO: `/v3/projects/e48beb7e571c40e6b1fb516367900280` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:12.892649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48beb7e571c40e6b1fb516367900280)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:12.908027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:13.095787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48beb7e571c40e6b1fb516367900280', 'request_id': 'req-4aea294a-5176-4945-b399-cbf6e3979116'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:13.140005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48beb7e571c40e6b1fb516367900280', 'request_id': 'req-4aea294a-5176-4945-b399-cbf6e3979116'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:13.171648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48beb7e571c40e6b1fb516367900280', 'request_id': 'req-4aea294a-5176-4945-b399-cbf6e3979116'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:13.226762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] The token cache is being invalidate because project e48beb7e571c40e6b1fb516367900280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:13.227941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:13.230391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4aea294a-5176-4945-b399-cbf6e3979116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:13.239800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 905/1822] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:12 2022] DELETE /identity/v3/projects/e48beb7e571c40e6b1fb516367900280 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:13.244412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:13.245213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:13.245620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:13.290174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:13.298309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:13.424634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 918/1823] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:13.432468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:13.432631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:13.432876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:13.469914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:13.471458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:13.513724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 906/1824] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:13.520172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:13.547297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb458497-eb6a-4319-bef7-07349272aa16 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:13.565295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:13.565989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:13.566291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:13.566570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:13.567312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:13.570574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:13.591519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:13.622027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 919/1825] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:13.625752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:13.647654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc9fa6-c2f1-49bd-b19b-58ee2f42a01d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:13.669664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:13.678784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:13.681062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:13.681387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:13.682150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:13.684199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ac5c-5eeb-4804-bfc5-3aa7c5e35ef2 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:13.762239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 907/1826] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:13 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:13.764637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:13.783922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669282-73b7-4355-8939-bc2c7703b933 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:13.959860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:13.961388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:13.962658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:13.964794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:13.966804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:13.997947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.003757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.004145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.004501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.038480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] MFA Rules not processed for user `8fe6db1f6d934ba0bd95826e6c76c556`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:14.041911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:14.063144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 920/1827] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:13 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:14.071202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.096104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b750f85-fe70-4866-8ca4-da5527f29538 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.106493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.107187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.107470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.107746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.112177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.113824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.132654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 921/1828] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:14.154173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.175608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4707d3-cbc5-46c3-99e2-b5f955bbfc9f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.182131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.183113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.183403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.183679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.184756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.188636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2682b4-708a-4898-af03-6dca51d45842 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.210378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 908/1829] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:14.223998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 922/1830] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:14.224166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.239252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d949-30c0-477a-b8a9-feeec9bfc0fd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.245336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.247187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.247525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.248076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] PATH_INFO: `/v3/projects/6444a21e01df4a22959cb322ed2b566f/users/26d5345ed3184c478f1f57b3238dba96/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.270421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6444a21e01df4a22959cb322ed2b566f, user_id=26d5345ed3184c478f1f57b3238dba96, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.274094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.298327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 909/1831] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:14 2022] PUT /identity/v3/projects/6444a21e01df4a22959cb322ed2b566f/users/26d5345ed3184c478f1f57b3238dba96/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:14.308577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.309688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.310581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.342956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] MFA Rules not processed for user `26d5345ed3184c478f1f57b3238dba96`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:14.344626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:14.488781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 923/1832] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:14.500962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.582131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917f94-640c-4e8c-9102-02344fa65942 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.587783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.588557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.588907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.589254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.590027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.592114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.629020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 910/1833] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:14 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:14.630375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.642297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb184-aa54-49b2-b943-de49dbdb1e50 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.704861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.705744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.706190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.706491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.707189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.709098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.731912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 924/1834] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:14 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:14.735903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.747572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7635f1-12a9-4da4-8e36-dada07df15b5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.753543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.754146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.754446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.754754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.755642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.760209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.771561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 911/1835] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:14.776015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.787349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60918d6-93ac-4442-a266-fc4f275ba68d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.793937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.795476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.796171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.796647 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] PATH_INFO: `/v3/projects/ca9964c6548b431783cb2613aedc8440/users/d3eccd986c9f41f1bf85f7b19717d696/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.818311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9964c6548b431783cb2613aedc8440, user_id=d3eccd986c9f41f1bf85f7b19717d696, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.821522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.846353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 925/1836] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:14 2022] PUT /identity/v3/projects/ca9964c6548b431783cb2613aedc8440/users/d3eccd986c9f41f1bf85f7b19717d696/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:14.850797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:14.866202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf851-17e3-41a4-84b7-5dc9098a9d11 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:14.960383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:14.961322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:14.961770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:14.962474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:14.963763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:14.966666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d2b94-cc2f-4ee4-b84b-97973cea4890 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:14.981778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 912/1837] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:14.986634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:15.005365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d94b0-21db-43c1-88c2-83ac5ed77b42 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:15.011817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:15.013636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.013971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.014407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] PATH_INFO: `/v3/projects/ca9964c6548b431783cb2613aedc8440/users/d3eccd986c9f41f1bf85f7b19717d696/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.016994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9964c6548b431783cb2613aedc8440, user_id=d3eccd986c9f41f1bf85f7b19717d696, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:15.021944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:15.041392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 926/1838] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:14 2022] PUT /identity/v3/projects/ca9964c6548b431783cb2613aedc8440/users/d3eccd986c9f41f1bf85f7b19717d696/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:15.053468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.053878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.054214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.056678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:15.059163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.089869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] MFA Rules not processed for user `d3eccd986c9f41f1bf85f7b19717d696`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:15.091195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.130064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fc41-31c6-448f-bff5-d289aa01c0d4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:15.137994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:15.139090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.139381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.140142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] PATH_INFO: `/v3/users/d8fddcff5e9e46f2a984298e20e49ef8` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.141387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fddcff5e9e46f2a984298e20e49ef8)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:15.143525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:15.163325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 913/1839] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:15.176628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:15.178401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.215433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fddcff5e9e46f2a984298e20e49ef8'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:15.228639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fddcff5e9e46f2a984298e20e49ef8'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:15.229522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fddcff5e9e46f2a984298e20e49ef8'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:15.231588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fddcff5e9e46f2a984298e20e49ef8'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:15.251943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7b3ede89-b11f-46ef-8cbd-3141ab34d85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fddcff5e9e46f2a984298e20e49ef8'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:15.264057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 927/1840] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:15 2022] DELETE /identity/v3/users/d8fddcff5e9e46f2a984298e20e49ef8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:15.266450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f41a-e037-42d4-9beb-0c7ca8f21803 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:15.268331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.268621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.268916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.289466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:15.290726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.360623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:15.361438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.361724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.362002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.364178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.365841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 928/1841] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:15.378361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:15.379972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.459166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:15.460622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:15.478545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 914/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:15.494044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c5960-20d2-45e8-bedd-3ed4c9623557 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:15.499795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:15.500940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.516612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.516612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.531703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:15.533886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.535112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:15.536605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:15.547006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c83c6-7ef8-4b25-b0df-8388d1dadd89 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:15.553990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:15.554780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:15.555227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:15.556094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:15.558069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:15.564360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 929/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:15.644770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:15.646353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:15.656368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 915/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:16.058540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:16.060127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:16.083641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcabed-6a41-43e5-b471-788369fafe36 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:16.088971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:16.089929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:16.090231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:16.090595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] PATH_INFO: `/v3/projects/db99e2f7e1454da48e71dba38695b18f` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:16.091826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db99e2f7e1454da48e71dba38695b18f)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:16.093764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:16.144531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db99e2f7e1454da48e71dba38695b18f', 'request_id': 'req-f4605418-29e9-48ad-897f-79d546e173f9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.149503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db99e2f7e1454da48e71dba38695b18f', 'request_id': 'req-f4605418-29e9-48ad-897f-79d546e173f9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.156950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db99e2f7e1454da48e71dba38695b18f', 'request_id': 'req-f4605418-29e9-48ad-897f-79d546e173f9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.167385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] The token cache is being invalidate because project db99e2f7e1454da48e71dba38695b18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:16.167666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.168269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.169860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 930/1845] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:16 2022] DELETE /identity/v3/projects/db99e2f7e1454da48e71dba38695b18f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:16.173863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:16.184598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99be020-fc59-4cc0-b341-6f8a1d3b4b9e service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:16.241460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:16.242371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:16.242651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:16.242923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] PATH_INFO: `/v3/users/937b4865a19f4e7b9e8d3d18856dba83` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:16.244145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937b4865a19f4e7b9e8d3d18856dba83)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:16.246078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:16.291989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937b4865a19f4e7b9e8d3d18856dba83'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.299034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937b4865a19f4e7b9e8d3d18856dba83'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.299706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937b4865a19f4e7b9e8d3d18856dba83'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.308084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937b4865a19f4e7b9e8d3d18856dba83'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.319872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eba4ab2e-a7e0-4431-8870-b03cefab8d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937b4865a19f4e7b9e8d3d18856dba83'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.325698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 916/1846] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:16 2022] DELETE /identity/v3/users/937b4865a19f4e7b9e8d3d18856dba83 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:16.721937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:16.723397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:16.747584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605418-29e9-48ad-897f-79d546e173f9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:16.877534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:16.878673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:16.878962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:16.879239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] PATH_INFO: `/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:16.881636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aafebe8fcc24adb9fcfdb28c2113d53)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:16.883612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:16.953072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aafebe8fcc24adb9fcfdb28c2113d53', 'request_id': 'req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.962352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aafebe8fcc24adb9fcfdb28c2113d53', 'request_id': 'req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:16.980705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aafebe8fcc24adb9fcfdb28c2113d53', 'request_id': 'req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:17.003712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] The token cache is being invalidate because project 1aafebe8fcc24adb9fcfdb28c2113d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:17.004075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:17.004843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2207e27a-57c1-4fa6-abab-d1f8b77dc09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:17.007331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 931/1847] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:16 2022] DELETE /identity/v3/projects/1aafebe8fcc24adb9fcfdb28c2113d53 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:17.013603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.014066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.014541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.046694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:17.054703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:17.131793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 917/1848] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:17.138155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.138470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.138747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.177786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:17.179023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:17.190308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 932/1849] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:17.192749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.212209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d9f8e-bf75-4b65-b1a6-7608caadd0ad None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.217323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.218549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.218933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.219305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.220161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:17.220932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.223001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.238849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 918/1850] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:17.240658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.251089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9422fd-2449-4ccf-816f-23c18b9e1248 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.256547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.257356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.258740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.259123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.259943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.262671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.296048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 933/1851] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:17.300505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.310992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6a58-d2a2-44b9-afe1-d97610dda5bd admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.387924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.388229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.388653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.389114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.390330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.393015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.416121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 919/1852] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:17.420357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.434745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08aba-df47-44a1-83b5-f3c46cfab7b0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.440776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.441554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.441839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.442365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.443158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.444948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.462749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 934/1853] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:17.463657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.474283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf39d57-0a89-4aa1-a01d-492bf0859711 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.480163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.480163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.480163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.480410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.481109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.482736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468902-2a83-4a59-9a4a-984f68c34587 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.492605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 920/1854] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:17.497931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.513071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0a8d-19c5-43ab-b124-2c64fb883903 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.520607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.521914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.522365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.522802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] PATH_INFO: `/v3/projects/c6962a9ae1794cffa3de31497729bd66/users/4df31ee82f89407ba6a45ed4a08354bf/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.544027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6962a9ae1794cffa3de31497729bd66, user_id=4df31ee82f89407ba6a45ed4a08354bf, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.548231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.564710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 935/1855] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:17 2022] PUT /identity/v3/projects/c6962a9ae1794cffa3de31497729bd66/users/4df31ee82f89407ba6a45ed4a08354bf/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:17.575190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043e75-37ed-4c36-b41c-108369271842 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.575477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043e75-37ed-4c36-b41c-108369271842 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.575751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61043e75-37ed-4c36-b41c-108369271842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.602984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-61043e75-37ed-4c36-b41c-108369271842 None None] MFA Rules not processed for user `4df31ee82f89407ba6a45ed4a08354bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:17.604218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-61043e75-37ed-4c36-b41c-108369271842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:17.672673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 921/1856] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:17.677342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.739583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e3b7-a347-4ca9-a67f-a5580b274c94 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.744640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.745307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.745583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.745878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.746984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.748874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.783816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 936/1857] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:17.787722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61043e75-37ed-4c36-b41c-108369271842 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.798403 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61043e75-37ed-4c36-b41c-108369271842 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.851955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.852629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.852973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.853179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.853870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.855797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.882013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 922/1858] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:17 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:17.883209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.893693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e975-75f7-4dc1-a3e5-a7c23388da69 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.898454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.899123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.899400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.899667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.900399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.901997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.912995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 937/1859] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:17.917267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.930001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5feede-0f92-47a4-bee8-4672a31f8953 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:17.935838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:17.936777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:17.937059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:17.937333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] PATH_INFO: `/v3/projects/73aa1e9bd0b745a4840d444da15edd17/users/de6a3082503e4687893b9961669dad15/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:17.954318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73aa1e9bd0b745a4840d444da15edd17, user_id=de6a3082503e4687893b9961669dad15, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:17.957126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:17.972413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 923/1860] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:17 2022] PUT /identity/v3/projects/73aa1e9bd0b745a4840d444da15edd17/users/de6a3082503e4687893b9961669dad15/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:17.976430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:17.986955 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986f12-2c35-49e4-86eb-7f78e95f76b9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:18.041965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:18.042688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:18.042974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:18.043247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:18.044060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:18.045642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473118a-1dfa-4f00-ae72-354332547c13 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:18.055759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 938/1861] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:18.059924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:18.070227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1281c2-1fd4-4e58-89d8-83af98d31483 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:18.074906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:18.075792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:18.076073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:18.076350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] PATH_INFO: `/v3/projects/73aa1e9bd0b745a4840d444da15edd17/users/de6a3082503e4687893b9961669dad15/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:18.078325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73aa1e9bd0b745a4840d444da15edd17, user_id=de6a3082503e4687893b9961669dad15, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:18.080948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:18.091100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 924/1862] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:18 2022] PUT /identity/v3/projects/73aa1e9bd0b745a4840d444da15edd17/users/de6a3082503e4687893b9961669dad15/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:18.102787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:18.103075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:18.103346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:18.130152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] MFA Rules not processed for user `de6a3082503e4687893b9961669dad15`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:18.131366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:18.201677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 939/1863] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:18.212972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:18.214849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:18.268940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf98f7b-6cc3-4eb0-b65f-3aa2ef2c246a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:18.273595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:18.274225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:18.274529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:18.274804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:18.284302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:18.285733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679476-cac5-490c-828d-88566ecb870d service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:18.295256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 925/1864] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:18.861684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:18.920493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16c5de-65ef-4a6d-863b-467eeebe8d12 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:18.925613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:18.926503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:18.926835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:18.927226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] PATH_INFO: `/v3/users/4df31ee82f89407ba6a45ed4a08354bf` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:18.928189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df31ee82f89407ba6a45ed4a08354bf)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:18.930123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:18.975094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df31ee82f89407ba6a45ed4a08354bf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:18.983771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df31ee82f89407ba6a45ed4a08354bf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:18.984551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df31ee82f89407ba6a45ed4a08354bf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:18.985306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df31ee82f89407ba6a45ed4a08354bf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:18.998596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df31ee82f89407ba6a45ed4a08354bf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.010923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 940/1865] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:18 2022] DELETE /identity/v3/users/4df31ee82f89407ba6a45ed4a08354bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:19.015518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.015796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.016117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.037848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:19.039388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:19.127406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 926/1866] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:19.136773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:19.138497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:19.194537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff420b-fc6b-4e65-a0cc-3b2576374833 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:19.198102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:19.198801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.199083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.199354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.209412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:19.210644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:19.220702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 941/1867] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:19.487243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:19.489224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:19.504205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4bf2-5669-4763-a488-67183ef167f3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:19.510645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:19.511430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.511718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.512009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] PATH_INFO: `/v3/projects/c6962a9ae1794cffa3de31497729bd66` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.513338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6962a9ae1794cffa3de31497729bd66)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:19.515346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:19.562477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6962a9ae1794cffa3de31497729bd66', 'request_id': 'req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.568440 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6962a9ae1794cffa3de31497729bd66', 'request_id': 'req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.574373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6962a9ae1794cffa3de31497729bd66', 'request_id': 'req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.588799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] The token cache is being invalidate because project c6962a9ae1794cffa3de31497729bd66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:19.589084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.589768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-d5702dbc-41b1-4fb2-bf42-68f68e83adcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.591656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 927/1868] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:19 2022] DELETE /identity/v3/projects/c6962a9ae1794cffa3de31497729bd66 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:19.595612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:19.605302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45237315-b4f4-4f32-baa0-09750b81d7c0 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:19.665653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:19.666267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.666569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.666839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] PATH_INFO: `/v3/users/de6a3082503e4687893b9961669dad15` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.668240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6a3082503e4687893b9961669dad15)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:19.670291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:19.737152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6a3082503e4687893b9961669dad15'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.748190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6a3082503e4687893b9961669dad15'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.749090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6a3082503e4687893b9961669dad15'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.749736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6a3082503e4687893b9961669dad15'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.764273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e95b2b67-6386-4346-b3cf-139f23af4619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6a3082503e4687893b9961669dad15'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:19.778171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 942/1869] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:19 2022] DELETE /identity/v3/users/de6a3082503e4687893b9961669dad15 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:19.911881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.912214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.912692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.915153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 928/1870] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:18:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:18:19.930111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:19.930651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:19.930726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:19.967663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:19.969500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:20.050351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 943/1871] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:20.070624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:20.072838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:20.098742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290022-1a74-41e8-8d8e-ca1b2902ebf9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:20.106530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:20.107205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:20.109412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:20.109701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:20.124918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:20.126898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1c9d4-70af-4158-a1dd-87c917b83182 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:20.187241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 929/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:21.050300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:21.052148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:21.225245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb0df-060d-4be6-a73f-f03338ae2a36 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:21.236368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:21.237589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.238458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.238458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] PATH_INFO: `/v3/projects/73aa1e9bd0b745a4840d444da15edd17` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.240230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73aa1e9bd0b745a4840d444da15edd17)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:21.242734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:21.313861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73aa1e9bd0b745a4840d444da15edd17', 'request_id': 'req-6246959c-17a4-4829-99a7-d250dd82a2a5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:21.334349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73aa1e9bd0b745a4840d444da15edd17', 'request_id': 'req-6246959c-17a4-4829-99a7-d250dd82a2a5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:21.351938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73aa1e9bd0b745a4840d444da15edd17', 'request_id': 'req-6246959c-17a4-4829-99a7-d250dd82a2a5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:21.379556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] The token cache is being invalidate because project 73aa1e9bd0b745a4840d444da15edd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:21.379737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:21.381666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6246959c-17a4-4829-99a7-d250dd82a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:21.404947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 944/1873] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:21 2022] DELETE /identity/v3/projects/73aa1e9bd0b745a4840d444da15edd17 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:21.406836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.407308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.407544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.460598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:21.461869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:21.558069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 930/1874] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:21.566383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.566658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.566971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.588569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:21.590030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:21.607347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 945/1875] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:21.612354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:21.627169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f13ed-934a-4642-9ed2-e492e5f9a874 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:21.638390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:21.639085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.639359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.639940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.640814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:21.641449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:21.643428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:21.659074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 931/1876] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:18:21.663048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:21.673265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef4395-327b-46cf-a60c-158f4f817b10 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:21.679905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:21.683393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.683796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.684208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.685267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:21.688089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:21.722786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 946/1877] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:21 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:21.723345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:21.747342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5301-393c-423c-a591-74c44ab88897 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:21.869577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:21.870350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.870634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.871089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.872230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:21.880134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:21.951631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 932/1878] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:21 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:21.956875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:21.977531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1ae1-bd56-4986-98d4-c57199ecb61b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:21.992688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:21.993402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:21.993677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:21.994208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:21.995019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.001479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.034117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.043341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 947/1879] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:22.045993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0d5a-0bd3-4bd9-9f88-093662713976 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.058649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.059722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.060172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.060585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.062008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.073869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.090299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.092677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.109467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 933/1880] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:22.115070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392eed-030d-486f-8b89-c5aa8aba3a4b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.122048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.122463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.124459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.125261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.126213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] PATH_INFO: `/v3/users/a46efc847772456b99bd4d3bf454af45` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.128432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46efc847772456b99bd4d3bf454af45)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.131033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.153979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2e58-2678-4dc6-b678-f130435b881f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.159591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.160719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.161944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.162432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] PATH_INFO: `/v3/projects/9790069551af49cc909b568949a165ee/users/409a091ca7404ca69fdb73941bfb55e0/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.216636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9790069551af49cc909b568949a165ee, user_id=409a091ca7404ca69fdb73941bfb55e0, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.224738 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a6503-7101-4702-8187-02b8cceb44e8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.233196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46efc847772456b99bd4d3bf454af45'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:22.246743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46efc847772456b99bd4d3bf454af45'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:22.247399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46efc847772456b99bd4d3bf454af45'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:22.248090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46efc847772456b99bd4d3bf454af45'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:22.272366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 934/1881] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:22 2022] PUT /identity/v3/projects/9790069551af49cc909b568949a165ee/users/409a091ca7404ca69fdb73941bfb55e0/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:22.274215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.274733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.275195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.282716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-241bed05-f6dc-4eb0-babc-88d7c9ddcb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46efc847772456b99bd4d3bf454af45'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:22.308031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 948/1882] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:22 2022] DELETE /identity/v3/users/a46efc847772456b99bd4d3bf454af45 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:22.309530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.309822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.310133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.322218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] MFA Rules not processed for user `409a091ca7404ca69fdb73941bfb55e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:22.323469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.331425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:22.332629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.407310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 935/1883] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:22.412572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.414060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.435460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 949/1884] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:22.458783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.462403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.527907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106ff7-fc36-4af9-a6d4-e3142943a656 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.535102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.536124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.536964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.537357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.538308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.540410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.550570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee91b4c-81fc-4371-a543-18288d0ae407 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.556989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.557906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.558245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.558507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.577391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 936/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:22 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:22.578606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.581621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.581860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.629364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 950/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:22.753975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba78f2-1276-475d-ba38-2f22c81c274f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.771297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.778921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.779997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.780712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.784639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.791222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.845074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 937/1887] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:22 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:22.847708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.862529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb5ee-f76d-4658-be48-7783a3d67b66 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.872400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.874803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:22.879161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.882810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.883902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.885547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.886953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.888792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.896992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819da40-6e6d-44a6-9e1f-da80e3adab2b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.917600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.917600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.917600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.917600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] PATH_INFO: `/v3/users/26d5345ed3184c478f1f57b3238dba96` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:22.918148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d5345ed3184c478f1f57b3238dba96)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:22.918231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 951/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:22.927544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:22.930847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:22.948836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed5d1-2355-4715-b575-4975564af2b5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:22.965265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:22.966405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:22.966775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:22.967150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] PATH_INFO: `/v3/projects/a727d1123db84e6883e3dc2ac52ada73/users/a81de4bfd8cb479e9c5288ac411de902/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.010878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a727d1123db84e6883e3dc2ac52ada73, user_id=a81de4bfd8cb479e9c5288ac411de902, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:23.017366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:23.054220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 952/1889] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:22 2022] PUT /identity/v3/projects/a727d1123db84e6883e3dc2ac52ada73/users/a81de4bfd8cb479e9c5288ac411de902/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:23.059290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:23.164390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d5345ed3184c478f1f57b3238dba96'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:23.196769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18fa5-f719-4f45-b565-d78c12fa2888 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:23.204977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d5345ed3184c478f1f57b3238dba96'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:23.208798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d5345ed3184c478f1f57b3238dba96'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:23.218042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:23.220942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.221435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.222164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.236475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d5345ed3184c478f1f57b3238dba96'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:23.237682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:23.245335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:23.278841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-98ff7350-574c-4ff1-bee2-327dff77d8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d5345ed3184c478f1f57b3238dba96'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:23.300248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 953/1890] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:23.304385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:23.306676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.307744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 938/1891] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:22 2022] DELETE /identity/v3/users/26d5345ed3184c478f1f57b3238dba96 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:23.312130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578a27-13c9-4cf5-807d-1fe605cc32be None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.312611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578a27-13c9-4cf5-807d-1fe605cc32be None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.313089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578a27-13c9-4cf5-807d-1fe605cc32be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.353147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-35578a27-13c9-4cf5-807d-1fe605cc32be None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:23.354365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-35578a27-13c9-4cf5-807d-1fe605cc32be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.356883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb951-0408-48b4-99a6-b6a1d5f0fa9b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:23.508598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 939/1892] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:23.579779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:23.580978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.582193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.582193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] PATH_INFO: `/v3/projects/a727d1123db84e6883e3dc2ac52ada73/users/a81de4bfd8cb479e9c5288ac411de902/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.583776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a727d1123db84e6883e3dc2ac52ada73, user_id=a81de4bfd8cb479e9c5288ac411de902, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:23.586486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:23.598207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 954/1893] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:23 2022] PUT /identity/v3/projects/a727d1123db84e6883e3dc2ac52ada73/users/a81de4bfd8cb479e9c5288ac411de902/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:23.608531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.608815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.609145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.645699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:23.647842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.677247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] MFA Rules not processed for user `a81de4bfd8cb479e9c5288ac411de902`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:23.683911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.780508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbfcbc-8f57-4364-9bb7-310a6991b818 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:23.795084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:23.795870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.796300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.796791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.859055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 940/1894] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:23.869571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:23.871743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.916345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:23.919010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:23.935754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 955/1895] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:23.938650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:23.943678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:23.965252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a641-7cb5-4610-92d9-e125843b6e77 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:23.973284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:23.974873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:23.975671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:23.977118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] PATH_INFO: `/v3/projects/a0f40b7d9c8e46f784c78e588c4c4e6d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:23.979222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f40b7d9c8e46f784c78e588c4c4e6d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:23.984653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:24.000782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182d09-8509-462f-bdb9-659b7b3693e3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:24.009492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:24.010863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:24.013373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:24.014761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:24.041180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:24.046357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:24.061814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 941/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:24.087182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f40b7d9c8e46f784c78e588c4c4e6d', 'request_id': 'req-6b8c928a-1654-445e-801a-9e9cb29df5ff'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.103467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f40b7d9c8e46f784c78e588c4c4e6d', 'request_id': 'req-6b8c928a-1654-445e-801a-9e9cb29df5ff'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.126134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f40b7d9c8e46f784c78e588c4c4e6d', 'request_id': 'req-6b8c928a-1654-445e-801a-9e9cb29df5ff'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.144541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] The token cache is being invalidate because project a0f40b7d9c8e46f784c78e588c4c4e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:24.144950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.145713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.150729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 956/1897] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:23 2022] DELETE /identity/v3/projects/a0f40b7d9c8e46f784c78e588c4c4e6d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:24.152184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:24.163835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a64b-2204-45e4-ae5b-f1c6fd2c1726 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:24.295908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:24.297948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:24.298429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:24.298848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] PATH_INFO: `/v3/users/346e3607a0fd49afa05516b9e7af11fa` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:24.300900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346e3607a0fd49afa05516b9e7af11fa)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:24.305849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:24.421482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346e3607a0fd49afa05516b9e7af11fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.445499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346e3607a0fd49afa05516b9e7af11fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.447647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346e3607a0fd49afa05516b9e7af11fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.467192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346e3607a0fd49afa05516b9e7af11fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.484285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346e3607a0fd49afa05516b9e7af11fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:24.494523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 942/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:24 2022] DELETE /identity/v3/users/346e3607a0fd49afa05516b9e7af11fa => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:24.794596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:24.796102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:24.818422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c928a-1654-445e-801a-9e9cb29df5ff admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:24.885284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:24.886802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.003455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.004908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.005364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.006436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] PATH_INFO: `/v3/users/15c85a1543764641a9da2536b74fbfcc` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.007814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c85a1543764641a9da2536b74fbfcc)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.009992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.031436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38d955-8945-4a17-a58d-39fc51f13be9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.044122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.045057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.045396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.045598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] PATH_INFO: `/v3/projects/6444a21e01df4a22959cb322ed2b566f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.047042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6444a21e01df4a22959cb322ed2b566f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.048941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.088836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c85a1543764641a9da2536b74fbfcc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.099247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c85a1543764641a9da2536b74fbfcc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.100572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c85a1543764641a9da2536b74fbfcc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.101584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c85a1543764641a9da2536b74fbfcc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.115821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c85a1543764641a9da2536b74fbfcc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.131274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 957/1899] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:24 2022] DELETE /identity/v3/users/15c85a1543764641a9da2536b74fbfcc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:25.132220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.133956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.158558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6444a21e01df4a22959cb322ed2b566f', 'request_id': 'req-83384b92-9906-4853-bd7e-5b72fc2ac301'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.171396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6444a21e01df4a22959cb322ed2b566f', 'request_id': 'req-83384b92-9906-4853-bd7e-5b72fc2ac301'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.184070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6444a21e01df4a22959cb322ed2b566f', 'request_id': 'req-83384b92-9906-4853-bd7e-5b72fc2ac301'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.200282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] The token cache is being invalidate because project 6444a21e01df4a22959cb322ed2b566f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:25.201026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.202012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-83384b92-9906-4853-bd7e-5b72fc2ac301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.207374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 943/1900] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:24 2022] DELETE /identity/v3/projects/6444a21e01df4a22959cb322ed2b566f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:25.209086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.209546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.209974 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.222993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecfda-41b1-4187-b582-cf10358c59fd admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.231762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.232814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.233192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.233564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] PATH_INFO: `/v3/users/409a091ca7404ca69fdb73941bfb55e0` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.234056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:25.235420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.235613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409a091ca7404ca69fdb73941bfb55e0)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.237949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.245838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 944/1901] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:25.247331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.250991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.266159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c858ba-8014-44f3-84c8-47c9649db452 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.273468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.274916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.275336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.276337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] PATH_INFO: `/v3/users/d3eccd986c9f41f1bf85f7b19717d696` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.278437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3eccd986c9f41f1bf85f7b19717d696)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.281265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.312220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409a091ca7404ca69fdb73941bfb55e0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.322280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409a091ca7404ca69fdb73941bfb55e0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.323120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409a091ca7404ca69fdb73941bfb55e0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.323928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409a091ca7404ca69fdb73941bfb55e0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.342049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409a091ca7404ca69fdb73941bfb55e0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.344721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3eccd986c9f41f1bf85f7b19717d696'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.353062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3eccd986c9f41f1bf85f7b19717d696'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.354525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3eccd986c9f41f1bf85f7b19717d696'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.357976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 958/1902] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:25 2022] DELETE /identity/v3/users/409a091ca7404ca69fdb73941bfb55e0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:25.359295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.361264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.370778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3eccd986c9f41f1bf85f7b19717d696'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.399029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a245ea10-79cc-4a4a-9383-f162c7a7afd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3eccd986c9f41f1bf85f7b19717d696'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.419301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 945/1903] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:25 2022] DELETE /identity/v3/users/d3eccd986c9f41f1bf85f7b19717d696 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:25.420800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.421184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.421578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.436855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655643a-dfca-491e-8ddf-191f9c4bc152 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.443734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:25.445491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.504774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.505912 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.506191 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.506534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.508818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.536306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 946/1904] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:25.537700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.540156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.557600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7d45e-afb6-4c64-8ade-0954849ee22e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.567917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.570940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.571240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.571519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] PATH_INFO: `/v3/projects/16715d595c0a46478ad59704e58aa453` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.574005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=16715d595c0a46478ad59704e58aa453)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.579516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.591338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.592793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.604426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 959/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:25.604973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.606664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.618840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635181-55b1-45ab-bbba-5cf41b595ec1 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.624316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.625003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.625293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.625546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.638240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.640509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac093f-22c4-4873-b266-823d4ed43a01 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.643574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16715d595c0a46478ad59704e58aa453', 'request_id': 'req-bdc4468d-83a8-4405-8dd7-083feb75b7ee'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.652457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16715d595c0a46478ad59704e58aa453', 'request_id': 'req-bdc4468d-83a8-4405-8dd7-083feb75b7ee'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.654413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 960/1906] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:25.660118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16715d595c0a46478ad59704e58aa453', 'request_id': 'req-bdc4468d-83a8-4405-8dd7-083feb75b7ee'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.678552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] The token cache is being invalidate because project 16715d595c0a46478ad59704e58aa453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:25.679216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.681034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-bdc4468d-83a8-4405-8dd7-083feb75b7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:25.683812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 947/1907] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:25 2022] DELETE /identity/v3/projects/16715d595c0a46478ad59704e58aa453 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:25.688701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.689175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.689450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.712519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:25.713848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.779176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 961/1908] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:25.787401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.787664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.787942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.828355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:25.829591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:25.842757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 948/1909] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:25.847824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.863778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e714-f6a8-4448-aa8a-8122d5744966 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.870195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.871075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.871911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.872188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.872927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:25.873406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.875063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.888510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 962/1910] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:18:25.893208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.906906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d45223-5e07-4038-89c2-eecfb012fb6d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:25.920032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:25.921021 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:25.921331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:25.921606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:25.923602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:25.926762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:25.967553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 949/1911] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:25.971594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:25.984495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841e20-6390-499f-bfce-9b24c97d315d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.053355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.054122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.054463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.054771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.055505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.061116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.104150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 963/1912] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:25 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:26.106944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.118745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4afc-8d2b-4e5a-a392-e93716b67f50 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.124855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.125207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.125486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.125802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.126576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.128802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.145220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 950/1913] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:26.146932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.162743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482938-f9b1-422b-8121-7348d6089b4f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.174494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.175657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.176208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.176696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.177635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.180137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.209553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 964/1914] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:26.211010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.270462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5811b-02fb-4a51-a510-93382eb8b164 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.287194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.287810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.287924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.288329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] PATH_INFO: `/v3/projects/91763eb15fff4e89b3edb064ce57dda8/users/76488ed93ae14ed9a1940fbf65165084/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.313335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.317778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.332277 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91763eb15fff4e89b3edb064ce57dda8, user_id=76488ed93ae14ed9a1940fbf65165084, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.337467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.350514 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e61b8-b309-4874-88ff-e49ca67c9a8d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.356691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.357801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.358153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.358538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] PATH_INFO: `/v3/projects/ca9964c6548b431783cb2613aedc8440` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.360126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9964c6548b431783cb2613aedc8440)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.364117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.370848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 951/1915] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:26 2022] PUT /identity/v3/projects/91763eb15fff4e89b3edb064ce57dda8/users/76488ed93ae14ed9a1940fbf65165084/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:26.382632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.384714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.475965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9964c6548b431783cb2613aedc8440', 'request_id': 'req-7dd56069-8d58-4750-8087-15250708debc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.483037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9964c6548b431783cb2613aedc8440', 'request_id': 'req-7dd56069-8d58-4750-8087-15250708debc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.504605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d4e8-708c-4501-9265-6e9adf2ef8bc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.508107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9964c6548b431783cb2613aedc8440', 'request_id': 'req-7dd56069-8d58-4750-8087-15250708debc'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.528116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] The token cache is being invalidate because project ca9964c6548b431783cb2613aedc8440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:26.528705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.529384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7dd56069-8d58-4750-8087-15250708debc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.531327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 965/1916] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:26 2022] DELETE /identity/v3/projects/ca9964c6548b431783cb2613aedc8440 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:26.532611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.532894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.533166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.566885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] MFA Rules not processed for user `76488ed93ae14ed9a1940fbf65165084`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:26.568292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.585057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.585943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.586221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.586524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] PATH_INFO: `/v3/projects/9790069551af49cc909b568949a165ee` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.589358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9790069551af49cc909b568949a165ee)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.589677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.666248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9790069551af49cc909b568949a165ee', 'request_id': 'req-3def20b4-500f-427f-b3ce-16cf854fcee3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.676202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9790069551af49cc909b568949a165ee', 'request_id': 'req-3def20b4-500f-427f-b3ce-16cf854fcee3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.679598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 966/1917] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:26.681097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.681889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9790069551af49cc909b568949a165ee', 'request_id': 'req-3def20b4-500f-427f-b3ce-16cf854fcee3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.682812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.703827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d092-2a55-4bc0-8c40-0e201d567ad8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.705081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] The token cache is being invalidate because project 9790069551af49cc909b568949a165ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:26.705833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.706822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3def20b4-500f-427f-b3ce-16cf854fcee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.709267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 952/1918] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:26 2022] DELETE /identity/v3/projects/9790069551af49cc909b568949a165ee => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:26.711151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.711605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.712119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.741370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:26.743888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.799015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.800132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.800424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.800697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] PATH_INFO: `/v3/projects/22613a0359224b36b9cdb32be35169bb` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.802570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22613a0359224b36b9cdb32be35169bb)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.804657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.840878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 953/1919] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:26.841811 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.843141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.857051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b8e7-3ef7-478e-8a22-696c53b484d3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:26.868269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22613a0359224b36b9cdb32be35169bb', 'request_id': 'req-4d0a265e-c264-44fb-b025-fe7b94276e3c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.874224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22613a0359224b36b9cdb32be35169bb', 'request_id': 'req-4d0a265e-c264-44fb-b025-fe7b94276e3c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.882744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22613a0359224b36b9cdb32be35169bb', 'request_id': 'req-4d0a265e-c264-44fb-b025-fe7b94276e3c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.900483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] The token cache is being invalidate because project 22613a0359224b36b9cdb32be35169bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:26.900786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.901539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:26.903572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 967/1920] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:26 2022] DELETE /identity/v3/projects/22613a0359224b36b9cdb32be35169bb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:26.906677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:26.906677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:26.941345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:26.942669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.943125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.943570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.944678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:26.947697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819927-b0c6-45fd-9767-ca5ea1dcd75a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:26.987150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 954/1921] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:26 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:26.987150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:26.987150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:26.987150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:26.998177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a265e-c264-44fb-b025-fe7b94276e3c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.014991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:27.016204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.067058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.067957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.068237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.068508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] PATH_INFO: `/v3/users/a81de4bfd8cb479e9c5288ac411de902` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.070513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81de4bfd8cb479e9c5288ac411de902)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.071831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.098414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 955/1922] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:27.099400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.101080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.114311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617fb8-31ab-4925-82f2-301626d9ee90 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.120937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.122170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.122481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.122754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] PATH_INFO: `/v3/users/02e69a1c69cd40848f51eabbecf54089` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.123969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e69a1c69cd40848f51eabbecf54089)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.126230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.131004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81de4bfd8cb479e9c5288ac411de902'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.140073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81de4bfd8cb479e9c5288ac411de902'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.140820 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81de4bfd8cb479e9c5288ac411de902'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.141505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81de4bfd8cb479e9c5288ac411de902'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.155133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81de4bfd8cb479e9c5288ac411de902'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.169012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 968/1923] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:26 2022] DELETE /identity/v3/users/a81de4bfd8cb479e9c5288ac411de902 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:27.169797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.171591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.180610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e69a1c69cd40848f51eabbecf54089'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.189816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e69a1c69cd40848f51eabbecf54089'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.191634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e69a1c69cd40848f51eabbecf54089'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.203688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e69a1c69cd40848f51eabbecf54089'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.221129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e69a1c69cd40848f51eabbecf54089'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.229103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 956/1924] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:27 2022] DELETE /identity/v3/users/02e69a1c69cd40848f51eabbecf54089 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:27.230055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.231499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.272660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3aa9-8b88-4df9-82be-92ea6c5f136f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.338439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c6ca1-e4a3-43e4-a77c-1156efb7edaf admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.343606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.344296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.344658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.345023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.345758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:27.346065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.348029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.358775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.359852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.361628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.361628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.361628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.363379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.364497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 957/1925] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:27.368046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.380567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11fdb5-63f3-4518-b57b-11bf29a5bfed admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.393044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.393754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.394039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.394969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.395337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.398005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.405533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 969/1926] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:27 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:27.406854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.409315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.432168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326b8af-eb43-4219-89c4-2287212a6b48 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.440296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.440946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.441272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.441608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.442621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.444529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.460681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 970/1927] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:27.461752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.474688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fafde-7f9c-40fb-b36b-51f5cb77f16c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.475151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 958/1928] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:27 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:27.479853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.544025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.545166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.545540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.545643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4bfc-1ca8-46c2-8f80-e6c0ee58aadd admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.545900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] PATH_INFO: `/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0/users/771737a7632c4763be0e359808fc28c1/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.551104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.551537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.551981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.552590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.553147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.555248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.566125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e08cd5085ea412d9ed38bdf97b5aac0, user_id=771737a7632c4763be0e359808fc28c1, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.569322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.584026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 971/1929] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:27 2022] PUT /identity/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0/users/771737a7632c4763be0e359808fc28c1/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:27.586557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 959/1930] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:27 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:27.591802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.593725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.606291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc86d2-34c4-49ba-839d-a8bef15d5934 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.670966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6186f77-13e6-4598-ae1d-8e1e79c6371e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.678240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.679053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.679880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.680232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.681039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.683351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.697652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 972/1931] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:27.700095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.701738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.723076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74612838-78f9-4aa5-ac72-449808ff9464 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.729622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.730639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.731307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.731586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] PATH_INFO: `/v3/projects/a727d1123db84e6883e3dc2ac52ada73` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.733585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a727d1123db84e6883e3dc2ac52ada73)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.735969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.736144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.737307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.737588 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.738055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.742925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.748548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.765934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 960/1932] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:27.765934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.779184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb05e-6b2c-4e68-8e3e-165e3e80d5cc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.786236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.787457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.788005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.788624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] PATH_INFO: `/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0/users/771737a7632c4763be0e359808fc28c1/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.791630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e08cd5085ea412d9ed38bdf97b5aac0, user_id=771737a7632c4763be0e359808fc28c1, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.796092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.798788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a727d1123db84e6883e3dc2ac52ada73', 'request_id': 'req-2a8ac62a-968b-4438-9741-d6a6279f3409'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.814991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a727d1123db84e6883e3dc2ac52ada73', 'request_id': 'req-2a8ac62a-968b-4438-9741-d6a6279f3409'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.819625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 961/1933] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:27 2022] PUT /identity/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0/users/771737a7632c4763be0e359808fc28c1/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:27.821427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.826487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.830569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a727d1123db84e6883e3dc2ac52ada73', 'request_id': 'req-2a8ac62a-968b-4438-9741-d6a6279f3409'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.850308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] The token cache is being invalidate because project a727d1123db84e6883e3dc2ac52ada73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:27.850731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.851610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.856975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 973/1934] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:27 2022] DELETE /identity/v3/projects/a727d1123db84e6883e3dc2ac52ada73 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:27.856975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:27.856975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:27.910515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76591-f188-4a0e-a037-903615794b7a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.915551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.916435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.916715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.916992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] PATH_INFO: `/v3/projects/cfeb44630ed2458393fa78cab98772e7` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.918193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeb44630ed2458393fa78cab98772e7)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.920198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.948246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac62a-968b-4438-9741-d6a6279f3409 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:27.954175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:27.954951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.955294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.955633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.956451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:27.958970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e74a66-ccbc-4ea3-bc57-0c26d91222d5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:27.968724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeb44630ed2458393fa78cab98772e7', 'request_id': 'req-07977d61-cd12-460b-abed-f5588d1a200c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.970093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 974/1935] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:27.971513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:27.971862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:27.972215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:27.975417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeb44630ed2458393fa78cab98772e7', 'request_id': 'req-07977d61-cd12-460b-abed-f5588d1a200c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.981933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeb44630ed2458393fa78cab98772e7', 'request_id': 'req-07977d61-cd12-460b-abed-f5588d1a200c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.998245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] The token cache is being invalidate because project cfeb44630ed2458393fa78cab98772e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:27.998245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:27.998815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-07977d61-cd12-460b-abed-f5588d1a200c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:28.000798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 962/1936] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:27 2022] DELETE /identity/v3/projects/cfeb44630ed2458393fa78cab98772e7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:28.002129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cefa8-2aa2-4e71-8397-5a424ccfe16e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.003858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cefa8-2aa2-4e71-8397-5a424ccfe16e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.003858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cefa8-2aa2-4e71-8397-5a424ccfe16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.010177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] MFA Rules not processed for user `771737a7632c4763be0e359808fc28c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.011412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.035619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-000cefa8-2aa2-4e71-8397-5a424ccfe16e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.037871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-000cefa8-2aa2-4e71-8397-5a424ccfe16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.119618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 975/1937] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.120359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.122377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.186197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 963/1938] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.186197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.186197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.186197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.219085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7bf3-597f-4b90-9e59-6046236d9387 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.233175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.234526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.235171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.235552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] PATH_INFO: `/v3/projects/4df42229ebb4472dad0de7c9ca78a1dd/users/d687585f0766415b92bd32c8fecda716/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.240691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.243290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.258023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 964/1939] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.259322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.260788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.272962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df42229ebb4472dad0de7c9ca78a1dd, user_id=d687585f0766415b92bd32c8fecda716, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.277638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006eb5-3459-4565-8460-1b17d7744e0f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.324957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 976/1940] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:28 2022] PUT /identity/v3/projects/4df42229ebb4472dad0de7c9ca78a1dd/users/d687585f0766415b92bd32c8fecda716/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:28.324957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3d02-687c-4686-86ef-e7cf23e6b985 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.324957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3d02-687c-4686-86ef-e7cf23e6b985 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.324957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3d02-687c-4686-86ef-e7cf23e6b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.341518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af34db-bf0b-45e8-8a7f-5410f789ce31 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.356792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-066f3d02-687c-4686-86ef-e7cf23e6b985 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.356792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-066f3d02-687c-4686-86ef-e7cf23e6b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.410196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.411023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.411395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.411742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.419033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 977/1941] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.423561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5227-e370-4f27-a0ae-36194caf7373 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.423850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5227-e370-4f27-a0ae-36194caf7373 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.424122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5227-e370-4f27-a0ae-36194caf7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.442220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-149d5227-e370-4f27-a0ae-36194caf7373 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.443917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-149d5227-e370-4f27-a0ae-36194caf7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.454470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 978/1942] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.456117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.456404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.456812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.477857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.479308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.494319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 965/1943] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:28.495664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.498865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] MFA Rules not processed for user `d687585f0766415b92bd32c8fecda716`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:28.500053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.514883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9919-4927-45ac-a000-882bf66bd6ab service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.529162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.529992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.530349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.530480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.531205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:28.531508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.533102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.549428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 966/1944] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:28.553926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.566349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad221d2-e67e-4fab-87df-29fa4eab4c49 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.571044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.571824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.572018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.572287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.573003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:28.573309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.575029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.590655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 967/1945] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:28.591663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.602298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 979/1946] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:28.602789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c610-6b1a-4ade-a997-35adcf4f580f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.603838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.608124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.608792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.609072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.609346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.610107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.612124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.620484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721afb-22b1-4007-a0b4-0f5e4693e707 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.626573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.627327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.628023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.628023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.628786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.631116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.655566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 968/1947] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:28.656380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.660378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 980/1948] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:28.661494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.718430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbd96-8e1a-4030-b2e9-85385c45362a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.718961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f0c4-f2a2-48e5-afe1-3007ade93a2c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.724028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.724649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.724927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.725202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.727176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:28.785002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.785677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.785950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.791410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.792590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.795745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.805508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.807139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.817248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 981/1949] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:28.818066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.832053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 969/1950] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:28.832334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dca34-af67-4db9-a186-0f137743797f service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.832413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.927702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386c21-6f00-473b-8854-44340e3f779f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.932433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.933105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.933384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.933726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.934493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.936542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.960613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.961299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.961568 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.961837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.965596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.965713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 970/1951] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:28.965713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.965947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:28.977962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99360f9f-d68b-4272-9183-4483dca20e43 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:28.988007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:28.989281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:28.992591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 982/1952] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:28.992591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:28.993486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:28.993967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:28.994886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:28.997537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.011447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345aad-003c-4d79-8728-7729e8312440 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.017208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.018025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.018422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.018793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.019810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.021499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.027879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 971/1953] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:28 2022] POST /identity/v3/users => generated 299 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:29.029238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.037206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 983/1954] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.038095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.043964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1774-7d78-4453-a6ef-2abb2359eba3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.049673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.050713 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.051092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.051461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.052416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.054042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.056198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d839-90bd-4b9c-bd9a-8be2b6bdda84 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.062745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.063526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.063881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.064219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.065026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.066898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 972/1955] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.067641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.070948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.081294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d22d05-2251-4dcb-92fe-eb463b122da6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.088991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 984/1956] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.089935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.094240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.095224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.095524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.095801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.096863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.102103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.110410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91622c1f-ce7d-487b-9a8b-a237132da221 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.116875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.117850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.121178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.121309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 973/1957] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.121758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.121866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.121951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.122763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.133213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5674b-4f17-4fdd-b9c9-98e0955814be admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.138193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 985/1958] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.138193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.138657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.139501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.139778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.140180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] PATH_INFO: `/v3/projects/dbaf960bb9fa462e896013a8a21de070/users/595fec9fb5d94f47bf6a6d1ecf4a3387/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.148175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf886a4b-e088-42f7-bb0c-185174aa9237 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.154239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.155162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.155439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.155709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] PATH_INFO: `/v3/projects/299b3adb7f5e47d4a8add78a581ff0f9/users/3809e80f36f7430ab36cb7b48ea358af/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.161685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaf960bb9fa462e896013a8a21de070, user_id=595fec9fb5d94f47bf6a6d1ecf4a3387, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.164686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.174962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299b3adb7f5e47d4a8add78a581ff0f9, user_id=3809e80f36f7430ab36cb7b48ea358af, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.177773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.182581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 974/1959] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:29 2022] PUT /identity/v3/projects/dbaf960bb9fa462e896013a8a21de070/users/595fec9fb5d94f47bf6a6d1ecf4a3387/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:29.183410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.198428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 986/1960] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:29 2022] PUT /identity/v3/projects/299b3adb7f5e47d4a8add78a581ff0f9/users/3809e80f36f7430ab36cb7b48ea358af/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:29.198428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.254611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75454e11-c5e0-4d28-bb2d-2e0a08c04670 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.277084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d927-de6e-4672-a258-f775b182d627 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.283768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.285008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.285296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.285558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.286778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.288435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe8884-db60-40ff-8459-a2e619365cf3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.302095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 987/1961] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.302095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.302095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.302095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.312054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.312959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.313241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.313773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] PATH_INFO: `/v3/projects/072b3945908d417aa93f236beea03dc8/users/bb63d42ebef246d88700f90a28e0e2e7/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.327016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] MFA Rules not processed for user `3809e80f36f7430ab36cb7b48ea358af`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:29.328224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.330525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=072b3945908d417aa93f236beea03dc8, user_id=bb63d42ebef246d88700f90a28e0e2e7, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.333182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.347661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 975/1962] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:29 2022] PUT /identity/v3/projects/072b3945908d417aa93f236beea03dc8/users/bb63d42ebef246d88700f90a28e0e2e7/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:29.348253 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.349888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.410035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 988/1963] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:29.411089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.415780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d74e-0220-4a3c-a2cc-03c4c28e770e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.423374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.423569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632be0-9e05-410c-9d3c-bc75a26a2bd4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.424272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.424551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.424832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] PATH_INFO: `/v3/users/76488ed93ae14ed9a1940fbf65165084` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.426032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76488ed93ae14ed9a1940fbf65165084)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.427999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.428736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.429856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.430553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.430927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] PATH_INFO: `/v3/projects/dbaf960bb9fa462e896013a8a21de070/users/595fec9fb5d94f47bf6a6d1ecf4a3387/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.433159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaf960bb9fa462e896013a8a21de070, user_id=595fec9fb5d94f47bf6a6d1ecf4a3387, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.436002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee464e8-7174-4fe0-9052-99d30aedf6a3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.457770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 989/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:29 2022] PUT /identity/v3/projects/dbaf960bb9fa462e896013a8a21de070/users/595fec9fb5d94f47bf6a6d1ecf4a3387/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:29.457770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bcff-a8e5-4246-96a4-141ed58cd539 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.457770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bcff-a8e5-4246-96a4-141ed58cd539 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.457770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bcff-a8e5-4246-96a4-141ed58cd539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.489062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-45a7bcff-a8e5-4246-96a4-141ed58cd539 None None] MFA Rules not processed for user `bb63d42ebef246d88700f90a28e0e2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:29.490518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-45a7bcff-a8e5-4246-96a4-141ed58cd539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.491138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76488ed93ae14ed9a1940fbf65165084'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:29.499064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76488ed93ae14ed9a1940fbf65165084'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:29.499795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76488ed93ae14ed9a1940fbf65165084'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:29.512113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76488ed93ae14ed9a1940fbf65165084'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:29.528574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76488ed93ae14ed9a1940fbf65165084'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:29.538005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 976/1965] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:29 2022] DELETE /identity/v3/users/76488ed93ae14ed9a1940fbf65165084 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:29.538005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.546328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.573002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 990/1966] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:29.574651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.575191 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.575543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.603094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] MFA Rules not processed for user `595fec9fb5d94f47bf6a6d1ecf4a3387`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:29.604406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.622268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72763-d752-429c-bba6-4d0194d66ed5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.627106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.627768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.628044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.628311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.628999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.630943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059616d-e52e-44fd-816c-699a195007ab admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.655989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 977/1967] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:29.657343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.657636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.657907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.673347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 991/1968] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:29.674492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.675052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:29.675958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.676298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.729394 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779775c6-edb0-45a1-a80a-29c43e1a4a3d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.734321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 978/1969] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:29.735143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.744047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a4f3-772f-438b-8b61-7c86980e6ee6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.749098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.749778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.750057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.750375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.751345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.753248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.776168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 979/1970] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:29 2022] POST /identity/v3/users => generated 294 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:29.776168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.776168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.785606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.786276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.786572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.786850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.835596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdc4ab-37eb-4abf-812b-f919e108988b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.839286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.840003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.840316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.840614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.845214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.846697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.855578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 992/1971] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:29.856403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.857687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:29.914078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.915681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.917459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92768c9-50ae-4a02-929e-27357186d124 service glance] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.921844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.922577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.922860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.923299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.933381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 980/1972] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:29.934202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:29.955039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.956930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.966998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e088-f53d-438b-b620-48ae379f8a8d service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:29.970421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 993/1973] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:29.974996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:29.975689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:29.975966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:29.978856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:29.979619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:29.981301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:29.992465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 981/1974] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:29.996925 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.013122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808152-ca3f-4c06-804c-0b2fb10adc13 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.022882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.024298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.024963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.025454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] PATH_INFO: `/v3/projects/b056de3372764829838ae148ee9606de/users/b5c22f522f7749fe9634d4f5bb1735f5/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.069825 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b056de3372764829838ae148ee9606de, user_id=b5c22f522f7749fe9634d4f5bb1735f5, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.074332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.102334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 994/1975] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:29 2022] PUT /identity/v3/projects/b056de3372764829838ae148ee9606de/users/b5c22f522f7749fe9634d4f5bb1735f5/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:30.104286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.119270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160b9e-9240-41cd-a18f-213c2fe72a52 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.201962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.203081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.203384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.203646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.204990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.206754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a38a0-e922-42d3-b010-3f8115c83818 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.223115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 982/1976] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:30.225941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.239256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f959a-e570-4c12-858c-6c73ea57e4da admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.248408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.249245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.249586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.250241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] PATH_INFO: `/v3/projects/b056de3372764829838ae148ee9606de/users/b5c22f522f7749fe9634d4f5bb1735f5/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.252206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b056de3372764829838ae148ee9606de, user_id=b5c22f522f7749fe9634d4f5bb1735f5, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.256272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.272200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 995/1977] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:30 2022] PUT /identity/v3/projects/b056de3372764829838ae148ee9606de/users/b5c22f522f7749fe9634d4f5bb1735f5/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:30.282997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.283581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.284500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.351092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] MFA Rules not processed for user `b5c22f522f7749fe9634d4f5bb1735f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:30.352524 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.375513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.379610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.443255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 983/1978] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:30.467644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.470506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.513938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf5696-cac5-4128-8fee-efed799f9765 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.535331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.536675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.537029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.537472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] PATH_INFO: `/v3/users/d687585f0766415b92bd32c8fecda716` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.539027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d687585f0766415b92bd32c8fecda716)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.541373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.555793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950550a-a7cb-4b90-bfa1-82700f2cd9f8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.560906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.561583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.561850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.562129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.566037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.613640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd687585f0766415b92bd32c8fecda716'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.625563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd687585f0766415b92bd32c8fecda716'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.626413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd687585f0766415b92bd32c8fecda716'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.628680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd687585f0766415b92bd32c8fecda716'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.648029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd687585f0766415b92bd32c8fecda716'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.663703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.665573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b958e-c76f-4e06-a3b8-8450f04f8c72 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.665947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 996/1979] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:30 2022] DELETE /identity/v3/users/d687585f0766415b92bd32c8fecda716 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:30.667994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.670031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.679212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 984/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:30.680751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.681048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.681399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.708311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:30.709525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.772141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf7caf-fb7e-4efb-9364-5f1ef23ac6c9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.779236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.780020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.780378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.780817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] PATH_INFO: `/v3/projects/91763eb15fff4e89b3edb064ce57dda8` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.782655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91763eb15fff4e89b3edb064ce57dda8)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.784750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.800430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 985/1981] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:30.817277 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.819151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.852397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91763eb15fff4e89b3edb064ce57dda8', 'request_id': 'req-52b3c993-60c7-45eb-aff3-be9892df4a17'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.857636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91763eb15fff4e89b3edb064ce57dda8', 'request_id': 'req-52b3c993-60c7-45eb-aff3-be9892df4a17'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.867366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91763eb15fff4e89b3edb064ce57dda8', 'request_id': 'req-52b3c993-60c7-45eb-aff3-be9892df4a17'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.881164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] The token cache is being invalidate because project 91763eb15fff4e89b3edb064ce57dda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:30.881471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.882224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:30.883930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 997/1982] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:30 2022] DELETE /identity/v3/projects/91763eb15fff4e89b3edb064ce57dda8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:30.888161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:30.889794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.893847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e4ed-c760-491c-a833-6d713ac051a9 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.947004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.947697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.947982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.948257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.950300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:30.961660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c993-60c7-45eb-aff3-be9892df4a17 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:30.962873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.967305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:30.967623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.968498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:30.968877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:30.969247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] PATH_INFO: `/v3/users/771737a7632c4763be0e359808fc28c1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:30.971860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771737a7632c4763be0e359808fc28c1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:30.973845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:30.979022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 986/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:31.094425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771737a7632c4763be0e359808fc28c1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.122133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771737a7632c4763be0e359808fc28c1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.123591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771737a7632c4763be0e359808fc28c1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.125148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771737a7632c4763be0e359808fc28c1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.156976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771737a7632c4763be0e359808fc28c1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.177584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 998/1984] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:30 2022] DELETE /identity/v3/users/771737a7632c4763be0e359808fc28c1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:31.337035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:31.338839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:31.354961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168861e-2865-4c99-8a21-73199e02193e service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:31.415433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:31.416311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.416587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.416857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] PATH_INFO: `/v3/projects/4df42229ebb4472dad0de7c9ca78a1dd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.418044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df42229ebb4472dad0de7c9ca78a1dd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:31.420034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:31.470018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df42229ebb4472dad0de7c9ca78a1dd', 'request_id': 'req-e1b9b843-1d18-4343-aeb2-02a577202b1a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.478078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df42229ebb4472dad0de7c9ca78a1dd', 'request_id': 'req-e1b9b843-1d18-4343-aeb2-02a577202b1a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.485879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df42229ebb4472dad0de7c9ca78a1dd', 'request_id': 'req-e1b9b843-1d18-4343-aeb2-02a577202b1a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.501341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] The token cache is being invalidate because project 4df42229ebb4472dad0de7c9ca78a1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:31.502071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.502930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.507725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 987/1985] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:31 2022] DELETE /identity/v3/projects/4df42229ebb4472dad0de7c9ca78a1dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:31.508953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:31.510648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:31.524300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990fb0c-b475-48c9-a080-638919aa2f61 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:31.554956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:31.556930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:31.616451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:31.617547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.617894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.618281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] PATH_INFO: `/v3/users/595fec9fb5d94f47bf6a6d1ecf4a3387` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.619946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] RBAC: Authorizing `identity:delete_user(user_id=595fec9fb5d94f47bf6a6d1ecf4a3387)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:31.622497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:31.627818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b843-1d18-4343-aeb2-02a577202b1a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:31.633482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:31.634436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.634723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.635121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] PATH_INFO: `/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.636302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e08cd5085ea412d9ed38bdf97b5aac0)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:31.638704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:31.672856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595fec9fb5d94f47bf6a6d1ecf4a3387'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.689282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595fec9fb5d94f47bf6a6d1ecf4a3387'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.690454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595fec9fb5d94f47bf6a6d1ecf4a3387'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.691441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595fec9fb5d94f47bf6a6d1ecf4a3387'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.693732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e08cd5085ea412d9ed38bdf97b5aac0', 'request_id': 'req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.703055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e08cd5085ea412d9ed38bdf97b5aac0', 'request_id': 'req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.709240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e08cd5085ea412d9ed38bdf97b5aac0', 'request_id': 'req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.710974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6e2a1724-be5a-4492-b67c-2ce08ee2918b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595fec9fb5d94f47bf6a6d1ecf4a3387'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.728760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 999/1986] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:31 2022] DELETE /identity/v3/users/595fec9fb5d94f47bf6a6d1ecf4a3387 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:31.745246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] The token cache is being invalidate because project 5e08cd5085ea412d9ed38bdf97b5aac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:31.746093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.747213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-483df8a5-fa48-40b4-b632-9f5d4cdbb7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:31.750283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 988/1987] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:31 2022] DELETE /identity/v3/projects/5e08cd5085ea412d9ed38bdf97b5aac0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:31.756916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.757202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.757468 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.778874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:31.780204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:31.916170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1000/1988] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:31.918756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.919278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.919757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.942884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:31.944111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:31.955991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 989/1989] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:31.957174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:31.971306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2600b6-95f4-4fa9-b2e7-78c0a7c6455c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:31.978926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:31.979592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:31.980136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:31.980425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:31.981276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:31.981540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:31.984029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.037090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1001/1990] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:18:32.041299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.054773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11c91d-b7ca-4193-8279-fa5e42ad0d22 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.060278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.061009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.061292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.061561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.062550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.064881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.142970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.144547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 990/1991] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:32.157703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0c52-42ca-4a31-8c14-32894238b670 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.282568 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.283297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.283582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.283858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.284558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.286508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.316584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1002/1992] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:32.324375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.342676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b075-48b1-4d4e-9522-d1611681ebf3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.348995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.349680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.350017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.350341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.351081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.352742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.369384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 991/1993] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:32.369904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.395652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87608-2ec5-4c3f-a214-b10dc14f0241 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.408019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.409178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.409178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.409451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.410987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.414188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.428266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.430234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.446875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1003/1994] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:32.451503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.462734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f032e-90ba-4800-8130-f11a940c0848 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.463348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4a3f-34fd-440a-a33f-245868881bb2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.470887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.472046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.472961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.473079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] PATH_INFO: `/v3/projects/6b48ba9e54104a1287c0bb0eb0219db1/users/16def957db4c46448e173da06c9a059a/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.475933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.477663 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.479112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.479707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] PATH_INFO: `/v3/projects/dbaf960bb9fa462e896013a8a21de070` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.483950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaf960bb9fa462e896013a8a21de070)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.489829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.537611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b48ba9e54104a1287c0bb0eb0219db1, user_id=16def957db4c46448e173da06c9a059a, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.540664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd803-6792-4d34-9b7d-f333eb01e8cc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.583133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaf960bb9fa462e896013a8a21de070', 'request_id': 'req-cf3bc714-0566-4b6b-822e-a758487e781d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.591714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaf960bb9fa462e896013a8a21de070', 'request_id': 'req-cf3bc714-0566-4b6b-822e-a758487e781d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.601806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1004/1995] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:32 2022] PUT /identity/v3/projects/6b48ba9e54104a1287c0bb0eb0219db1/users/16def957db4c46448e173da06c9a059a/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:32.601987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaf960bb9fa462e896013a8a21de070', 'request_id': 'req-cf3bc714-0566-4b6b-822e-a758487e781d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.605320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.605622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.605902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.615941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] The token cache is being invalidate because project dbaf960bb9fa462e896013a8a21de070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:32.616306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-cf3bc714-0566-4b6b-822e-a758487e781d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 992/1996] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:32 2022] DELETE /identity/v3/projects/dbaf960bb9fa462e896013a8a21de070 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:32.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c73e7-8c49-43b1-ad01-ceda7f256800 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c73e7-8c49-43b1-ad01-ceda7f256800 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.625312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c73e7-8c49-43b1-ad01-ceda7f256800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.648667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e79c73e7-8c49-43b1-ad01-ceda7f256800 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:32.650033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e79c73e7-8c49-43b1-ad01-ceda7f256800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.672206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] MFA Rules not processed for user `16def957db4c46448e173da06c9a059a`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:32.673969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.727199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 993/1997] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:32.734529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289316-0a35-4628-81df-010415a12294 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.734921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289316-0a35-4628-81df-010415a12294 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.735541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289316-0a35-4628-81df-010415a12294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.741831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1005/1998] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:32.755200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.755539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-37289316-0a35-4628-81df-010415a12294 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:32.756730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-37289316-0a35-4628-81df-010415a12294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.757353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.766153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 994/1999] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:32.770408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289316-0a35-4628-81df-010415a12294 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.779386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289316-0a35-4628-81df-010415a12294 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.785940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.786651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.786933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.787206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.788427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:32.788897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.790352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.802008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 995/2000] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:32.806421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.815895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640cfd-d3c1-407d-b649-5687678699b6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.819004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e44d2c-30b8-44c1-8796-49809cd550e5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.820460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.821096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.821378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.821710 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.822435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.822668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.823314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.823593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.823884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.824312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.831926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.833334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.842470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1006/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:32.850529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 996/2002] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:32.854634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.861759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.863463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:32.865758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e560b-677a-44dc-a250-d544fb42a7f5 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.929023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.929248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d404-3df5-437f-955f-9fa4a19c72fd admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.929811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.930146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.930454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.931133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.933042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.934279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.935175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.935488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.935765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] PATH_INFO: `/v3/users/16def957db4c46448e173da06c9a059a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.937012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16def957db4c46448e173da06c9a059a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.938995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.953446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1007/2003] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:32 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:32.957574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.968051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708b0b1-53bd-4e84-8d3f-4413dea5ed06 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:32.972855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:32.973702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:32.974046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:32.974360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:32.975087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:32.976659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:32.986042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16def957db4c46448e173da06c9a059a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.986485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1008/2004] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:32.990315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:32.995576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16def957db4c46448e173da06c9a059a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:32.996767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16def957db4c46448e173da06c9a059a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:33.000233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbbb4-0885-4c4d-adc7-3aea2206e82a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.005152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16def957db4c46448e173da06c9a059a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:33.005444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.006086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.006411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.006684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.007395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.008952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.022450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1009/2005] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:33.023215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c602be31-9430-4514-b6a7-50c782fa5d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16def957db4c46448e173da06c9a059a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:33.023536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.026208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.030030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 997/2006] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:32 2022] DELETE /identity/v3/users/16def957db4c46448e173da06c9a059a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:33.035384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.035384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.035384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.040683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7f4b-c33f-41d8-9574-9df9201ca028 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.054799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:33.055977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.120842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.122122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.122429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.122733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] PATH_INFO: `/v3/projects/9943c074a872409fb9500506720866ad/users/5b0eaaa63025405690f33954d14f3af7/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.129320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 998/2007] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:33.138872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.140381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.144934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9943c074a872409fb9500506720866ad, user_id=5b0eaaa63025405690f33954d14f3af7, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.148023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa024fd-2a30-43e9-91c2-9dac1b616dcf admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.163062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1010/2008] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:33 2022] PUT /identity/v3/projects/9943c074a872409fb9500506720866ad/users/5b0eaaa63025405690f33954d14f3af7/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:33.174741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.175028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.175314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.211128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] MFA Rules not processed for user `5b0eaaa63025405690f33954d14f3af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:33.211589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cf02-a596-43ac-97fc-eb0f41e76e45 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.212317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.267809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.268476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.268757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.269029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.285488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1011/2009] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:33.286501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.371686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302eaa-9c3e-4119-b2c6-f8c9c7bc902f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.375719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.376579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.377185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.377334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.378044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.378500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.379266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.381245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.388032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 999/2010] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:33.413337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1012/2011] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:33.414871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.425120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8c654-b135-4e32-9df7-04e700742c07 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.485748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.486467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.486750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.487058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.489676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.493208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.514513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1000/2012] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:33.518769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.535539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46d54b-9a6c-4be5-bb32-adbd739f3e87 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.541709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.542499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.542781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.543510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.543819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.545414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.564026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1013/2013] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:33.565168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.577167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb397c45-a04c-499a-a276-0fc2f0a3b88f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.582436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.583287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.583577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.583852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.584592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.586200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c483248-131e-4981-80b7-bf47b153b6ed admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.607958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1001/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:33.609995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.631276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c558e91-e2d3-4e22-81b7-1c9b1729f8e2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.636159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.637107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.637390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.637664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] PATH_INFO: `/v3/projects/87441dbe4e24436090790112aded9d76/users/67f7b2661ac04d9b8d29785187261e82/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.652329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87441dbe4e24436090790112aded9d76, user_id=67f7b2661ac04d9b8d29785187261e82, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.655040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.682549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1014/2015] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:33 2022] PUT /identity/v3/projects/87441dbe4e24436090790112aded9d76/users/67f7b2661ac04d9b8d29785187261e82/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:33.684176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.684509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.684740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.710247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] MFA Rules not processed for user `67f7b2661ac04d9b8d29785187261e82`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:33.711469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.773802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1002/2016] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:33.778418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.811496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.813173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:33.852409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb77e1-8812-48b4-86db-ba2aa899d14d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.857990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.858697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.858977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.859239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.859951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.862089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.890981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1015/2017] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:18:33.892281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:33.894936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a291c3-1fbf-4817-84ec-d719b1c2d922 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.947725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.948604 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.948885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.949162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] PATH_INFO: `/v3/projects/6b48ba9e54104a1287c0bb0eb0219db1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.950475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b48ba9e54104a1287c0bb0eb0219db1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.952159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18dfb-a332-48b5-b4ba-65aaef0507eb admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:33.952372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.957415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:33.958086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:33.958403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:33.959318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:33.960004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:33.961919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:33.986517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1016/2018] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:33 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:33.990696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.000866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd07b9-00b0-4a08-9f9d-7d24d4077aaf admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.004016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b48ba9e54104a1287c0bb0eb0219db1', 'request_id': 'req-c4763bdc-d76a-4689-b029-f6ad52545f6d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:34.010872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b48ba9e54104a1287c0bb0eb0219db1', 'request_id': 'req-c4763bdc-d76a-4689-b029-f6ad52545f6d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:34.018115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b48ba9e54104a1287c0bb0eb0219db1', 'request_id': 'req-c4763bdc-d76a-4689-b029-f6ad52545f6d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:34.033328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] The token cache is being invalidate because project 6b48ba9e54104a1287c0bb0eb0219db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:34.033630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:34.034348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c4763bdc-d76a-4689-b029-f6ad52545f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:34.036217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1003/2019] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:33 2022] DELETE /identity/v3/projects/6b48ba9e54104a1287c0bb0eb0219db1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:34.041360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32f-84b1-4260-a83d-eac2572eff86 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.041579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32f-84b1-4260-a83d-eac2572eff86 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.041885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32f-84b1-4260-a83d-eac2572eff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.060660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c6abe32f-84b1-4260-a83d-eac2572eff86 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:34.061836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c6abe32f-84b1-4260-a83d-eac2572eff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.064438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.065111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.065391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.065660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.066418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.068011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.069639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1004/2020] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:34.077223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.077513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.077790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.077913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1017/2021] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:34.081728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.083476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.095482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3339-7794-45ec-ae31-92633bf08d8e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.096426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:34.097707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.100323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.101240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.101517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.101787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] PATH_INFO: `/v3/projects/86bc623b0ace4931a3f820416710509f/users/301d8268a40a4cf5ac263a2cda0c0678/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.105901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1005/2022] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:34.110016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.117093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc623b0ace4931a3f820416710509f, user_id=301d8268a40a4cf5ac263a2cda0c0678, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.118749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdcd9-5589-4376-a416-3acac26e831a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.119848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.123941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.124872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.125149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.125424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.126179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:34.126507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.128122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.133716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1018/2023] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:34 2022] PUT /identity/v3/projects/86bc623b0ace4931a3f820416710509f/users/301d8268a40a4cf5ac263a2cda0c0678/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:34.137525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.142657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1006/2024] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:18:34.146873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.156265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabde4c-9706-41e0-91c0-06e9808e4d7e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.197635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6477768-59d3-484a-a27a-f8c5504a4115 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.202799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a232c-b129-4208-912d-366859309618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.203455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a232c-b129-4208-912d-366859309618 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.203734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a232c-b129-4208-912d-366859309618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.204005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a232c-b129-4208-912d-366859309618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.204790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a232c-b129-4208-912d-366859309618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.206461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a232c-b129-4208-912d-366859309618 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.213690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.214907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.214907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.215112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.215730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.217667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.222487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1019/2025] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:34.222487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a232c-b129-4208-912d-366859309618 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.231738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a232c-b129-4208-912d-366859309618 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.237175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.238095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.238424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.238680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] PATH_INFO: `/v3/projects/86bc623b0ace4931a3f820416710509f/users/301d8268a40a4cf5ac263a2cda0c0678/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.240698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc623b0ace4931a3f820416710509f, user_id=301d8268a40a4cf5ac263a2cda0c0678, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.243456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc989f-32f9-471d-ba5c-95d442fae4f4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.249981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1007/2026] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:34.254396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.263405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1020/2027] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:34 2022] PUT /identity/v3/projects/86bc623b0ace4931a3f820416710509f/users/301d8268a40a4cf5ac263a2cda0c0678/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:34.279778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.280086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.280332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.323966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] MFA Rules not processed for user `301d8268a40a4cf5ac263a2cda0c0678`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:34.325425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.347482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0837ba-adef-4617-a48f-2a9e428860bc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.405946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1021/2028] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:34.406126 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.407357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.407785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.408526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.409364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.411914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.417917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.419473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.435598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1008/2029] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:34.437153 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.446216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67e7-d469-4ea8-96c7-2c486f92bd21 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.450966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.451614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.451900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.452174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.452897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.454515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.464152 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1009/2030] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:34.468146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.473801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21c384-c4c7-4a3e-9dcd-52337be93f93 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.478496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f4958-0dbb-4ad6-8e49-0991a83f23c1 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.478852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.479530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.479810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.480083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.483462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.484176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.484462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.484752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.485571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.487523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.490549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.492006 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.502249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1010/2031] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:34.503325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1022/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:34.503475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.513356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811d2f1-010f-48e9-be50-d8d944eb870c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.518130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.519042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.519443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.519679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] PATH_INFO: `/v3/projects/c22207151467401697a2e27ce66fbc1f/users/3f1cedefc7254a4797b7d6ca461a065c/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.535667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22207151467401697a2e27ce66fbc1f, user_id=3f1cedefc7254a4797b7d6ca461a065c, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.538344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7683c0-e9b3-408e-b7bc-67ba6bebf817 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.546167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.547608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.552567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1011/2033] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:34 2022] PUT /identity/v3/projects/c22207151467401697a2e27ce66fbc1f/users/3f1cedefc7254a4797b7d6ca461a065c/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:34.556952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.557173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.557445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.558884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b93f-02cd-454c-b96f-bf3165df2146 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.573714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:34.574965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.607447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.608100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.608393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.608654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.611415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.637176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1012/2034] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:34.646885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:34.649029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:34.672369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.674328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f4b80-aa32-493e-ac6e-7f35dffde61c service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.684069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1023/2035] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:18:34.713020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb07d9-3f0d-41e4-8bcc-124d9222a926 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:34.716934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:34.717593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:34.717874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:34.718144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:34.741791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:34.744246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:34.757509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1013/2036] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:35.444974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:35.445526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:35.445646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:35.476172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] MFA Rules not processed for user `3f1cedefc7254a4797b7d6ca461a065c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:35.477789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:35.556762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1024/2037] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:35.568197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:35.578077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879ce0-372f-4f01-b2e1-396b6a4bd8c6 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:35.581693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:35.582450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:35.582690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:35.583315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:35.595140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:35.596657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bd75e-802a-41ae-9e52-a5a81c182409 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:35.605888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1014/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:36.690886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:36.700526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb72f-f7f7-46d8-a25f-ef4d53325e8d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:36.704137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:36.704776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:36.705054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:36.705323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:36.707219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:36.769005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:36.771207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:36.784429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1025/2039] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:36.947865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5078d-6da5-4db6-bb9d-c6dcd33bf32e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:36.948391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5078d-6da5-4db6-bb9d-c6dcd33bf32e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:36.948498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5078d-6da5-4db6-bb9d-c6dcd33bf32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:36.966032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c6a5078d-6da5-4db6-bb9d-c6dcd33bf32e None None] MFA Rules not processed for user `3f1cedefc7254a4797b7d6ca461a065c`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:36.967238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c6a5078d-6da5-4db6-bb9d-c6dcd33bf32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:36.974425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1015/2040] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:41.872485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:41.891127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd25c-5961-4e2a-9802-47abe02c45d7 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:41.891127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:41.891127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:41.891127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:41.891459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] PATH_INFO: `/v3/users/5b0eaaa63025405690f33954d14f3af7` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:41.892896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0eaaa63025405690f33954d14f3af7)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:41.895064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:41.954044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0eaaa63025405690f33954d14f3af7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:41.968787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0eaaa63025405690f33954d14f3af7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:41.969981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0eaaa63025405690f33954d14f3af7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:41.970755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0eaaa63025405690f33954d14f3af7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:41.985828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0eaaa63025405690f33954d14f3af7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:41.998746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1026/2041] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:41 2022] DELETE /identity/v3/users/5b0eaaa63025405690f33954d14f3af7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:42.003266 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:42.004320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:42.004744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:42.022863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:42.024267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:42.088175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1016/2042] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:42.099360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:42.101086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:42.173983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cf74-0ee4-4fdd-9f3f-a15dce1f27b5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:42.178070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:42.179077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:42.179499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:42.179904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:42.190181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:42.192053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:42.203010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1027/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:42.706516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:42.712147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:42.733437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa00d4-0356-4972-9f74-c9d9bf7308dc None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:42.756747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:42.761639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:42.762602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:42.763110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] PATH_INFO: `/v3/projects/9943c074a872409fb9500506720866ad` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:42.765301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9943c074a872409fb9500506720866ad)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:42.770271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:42.839419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9943c074a872409fb9500506720866ad', 'request_id': 'req-906dd867-5479-485d-8983-1eda10e60b57'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.847029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9943c074a872409fb9500506720866ad', 'request_id': 'req-906dd867-5479-485d-8983-1eda10e60b57'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.853082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9943c074a872409fb9500506720866ad', 'request_id': 'req-906dd867-5479-485d-8983-1eda10e60b57'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.867300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] The token cache is being invalidate because project 9943c074a872409fb9500506720866ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:42.867586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.868210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.869988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1017/2044] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:42 2022] DELETE /identity/v3/projects/9943c074a872409fb9500506720866ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:42.874236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:42.883713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3470-ddb1-4568-9ba9-7c48d5016003 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:42.940174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:42.941748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:42.942029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:42.942330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] PATH_INFO: `/v3/users/67f7b2661ac04d9b8d29785187261e82` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:42.943516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f7b2661ac04d9b8d29785187261e82)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:42.945455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:42.990464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f7b2661ac04d9b8d29785187261e82'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.999121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f7b2661ac04d9b8d29785187261e82'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:42.999737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f7b2661ac04d9b8d29785187261e82'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:43.000324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f7b2661ac04d9b8d29785187261e82'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:43.012357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f7b2661ac04d9b8d29785187261e82'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:43.024242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1028/2045] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:42 2022] DELETE /identity/v3/users/67f7b2661ac04d9b8d29785187261e82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:44.023613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:44.025720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:44.041701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dd867-5479-485d-8983-1eda10e60b57 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:44.118359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:44.119256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:44.119539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:44.119814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] PATH_INFO: `/v3/projects/87441dbe4e24436090790112aded9d76` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:44.121031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87441dbe4e24436090790112aded9d76)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:44.123360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:44.177520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87441dbe4e24436090790112aded9d76', 'request_id': 'req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.184840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87441dbe4e24436090790112aded9d76', 'request_id': 'req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.191866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87441dbe4e24436090790112aded9d76', 'request_id': 'req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.226714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] The token cache is being invalidate because project 87441dbe4e24436090790112aded9d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:44.226714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.227780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.229431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1018/2046] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:44 2022] DELETE /identity/v3/projects/87441dbe4e24436090790112aded9d76 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:44.233715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:44.235258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:44.249957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a19c99-9b5a-4c83-8ad7-1c00f29d4d62 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:44.312928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:44.313898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:44.314242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:44.314613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] PATH_INFO: `/v3/users/301d8268a40a4cf5ac263a2cda0c0678` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:44.315882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=301d8268a40a4cf5ac263a2cda0c0678)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:44.317949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:44.371372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301d8268a40a4cf5ac263a2cda0c0678'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.380148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301d8268a40a4cf5ac263a2cda0c0678'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.381147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301d8268a40a4cf5ac263a2cda0c0678'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.382436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301d8268a40a4cf5ac263a2cda0c0678'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.395623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-295b513b-6a9c-40c6-b12f-2f8429dbb2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301d8268a40a4cf5ac263a2cda0c0678'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:44.422715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1029/2047] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:44 2022] DELETE /identity/v3/users/301d8268a40a4cf5ac263a2cda0c0678 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:18:45.113413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.115009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:45.136099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa935d-3ca2-40ca-a00a-e2079ae12b2a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.208749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.209739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.210025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.210347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] PATH_INFO: `/v3/projects/86bc623b0ace4931a3f820416710509f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.211627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bc623b0ace4931a3f820416710509f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.214079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.280254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bc623b0ace4931a3f820416710509f', 'request_id': 'req-0260735f-a426-4af8-8b79-6f02ffa03a79'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:45.287207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bc623b0ace4931a3f820416710509f', 'request_id': 'req-0260735f-a426-4af8-8b79-6f02ffa03a79'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:45.293275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bc623b0ace4931a3f820416710509f', 'request_id': 'req-0260735f-a426-4af8-8b79-6f02ffa03a79'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:45.308444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] The token cache is being invalidate because project 86bc623b0ace4931a3f820416710509f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:18:45.308796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:45.309626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0260735f-a426-4af8-8b79-6f02ffa03a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:45.311415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1019/2048] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:18:45 2022] DELETE /identity/v3/projects/86bc623b0ace4931a3f820416710509f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:45.317388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.317892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.317991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.337902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:45.339307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:45.429660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1030/2049] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:45.435166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.435456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.435732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.456770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:45.458586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:45.469171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1020/2050] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:45.473213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.484747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3bdb8-9869-439e-94f5-947a38dfe6e1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.489431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.490237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.490547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.490815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.491538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:18:45.491838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.493498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.505803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1031/2051] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:18:45.510451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.519638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a441fa-e661-4f2a-9757-a99c25e026b8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.524319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.524976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.525259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.525531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.526245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.528251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.556558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1021/2052] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:45 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:45.560888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.571485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbedf-465a-40d5-a98e-4c4028d69d38 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.644751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.645594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.645973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.646384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.647177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.649365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.674972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1032/2053] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:45 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:45.676327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.702770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e51942-b153-43e4-9911-67503fed2578 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.712135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.712873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.713186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.713883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.715035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.717725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.731389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1022/2054] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:45.735183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.749350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b9ee-ce5a-4183-8692-7d2682679dd3 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.755293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.756014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.756377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.756653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.757386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.759064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500230df-1a90-4501-bb6d-76387cbac4ac admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.776494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:45.780033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1033/2055] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:45.787346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e73e-fc25-4a6b-a04e-a521e614f7ad admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:45.792480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:45.793579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.793863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.794136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] PATH_INFO: `/v3/projects/ee9e66b971ab4f29b88b2400d280fe75/users/1a6c3e536c17486b91d199b0c838db27/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.813263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9e66b971ab4f29b88b2400d280fe75, user_id=1a6c3e536c17486b91d199b0c838db27, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:45.816736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:45.838490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1023/2056] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:45 2022] PUT /identity/v3/projects/ee9e66b971ab4f29b88b2400d280fe75/users/1a6c3e536c17486b91d199b0c838db27/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:45.840411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6e43-4f7e-4039-b8ac-ac4e69f9abc4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:45.840610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6e43-4f7e-4039-b8ac-ac4e69f9abc4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:45.840942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c6e43-4f7e-4039-b8ac-ac4e69f9abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:45.879397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-151c6e43-4f7e-4039-b8ac-ac4e69f9abc4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:45.880621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-151c6e43-4f7e-4039-b8ac-ac4e69f9abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:45.995198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1034/2057] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:46.006757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:46.008902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:46.088460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128872ec-208a-4e9e-bcf2-37ddd140968c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:46.092793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:46.093785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:46.094322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:46.094829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:46.105763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:46.107799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:46.118862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1024/2058] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:47.419771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:47.420404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:47.420631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:47.478778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] MFA Rules not processed for user `1a6c3e536c17486b91d199b0c838db27`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:47.482687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:47.637255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1035/2059] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:18:47.641958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:47.652627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cb15c-48a5-4afc-a86c-9706a013b4aa service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:47.669071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:47.670090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:47.670553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:47.670980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:47.671830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:47.673877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:47.709800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1025/2060] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:18:47 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:47.712740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:47.725525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9161-2b11-43c7-aa74-428d82cefc8c None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:47.802892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:47.803592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:47.803858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:47.804123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:47.804824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:47.807336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:47.839498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:47.840572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1036/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:18:47 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:18:47.853781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e73a-8374-4c63-b94b-eca89a52cad4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:47.858868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:47.859818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:47.860279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:47.860549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:47.861483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:47.863405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:47.875556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1026/2062] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:18:47.879804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:47.891273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d9cb2-bbbd-4b24-95ec-9d9fcd21e38d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:47.896095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:47.897028 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:47.897306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:47.897577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] PATH_INFO: `/v3/projects/9dfbe0a654e9419abb4435048ee583d4/users/cc265ab392ad4a87ab078fd16adb7614/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:47.913937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfbe0a654e9419abb4435048ee583d4, user_id=cc265ab392ad4a87ab078fd16adb7614, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:47.916910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:47.941637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1037/2063] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:47 2022] PUT /identity/v3/projects/9dfbe0a654e9419abb4435048ee583d4/users/cc265ab392ad4a87ab078fd16adb7614/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:47.945601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:47.956249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8b92-994e-4425-b173-85b7cc1088e5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:48.014875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:48.015458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:48.015735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:48.015971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:48.016906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:48.018642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75591fd0-b9ba-4404-83a6-f252bf4be9d2 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:48.031799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1027/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:18:48.044184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:48.061771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b78c-246e-4577-9e67-5a95d83fbba1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:48.067228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:48.068253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:48.068631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:48.068998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] PATH_INFO: `/v3/projects/9dfbe0a654e9419abb4435048ee583d4/users/cc265ab392ad4a87ab078fd16adb7614/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:48.071542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfbe0a654e9419abb4435048ee583d4, user_id=cc265ab392ad4a87ab078fd16adb7614, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:48.074480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:48.085978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1038/2065] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:18:48 2022] PUT /identity/v3/projects/9dfbe0a654e9419abb4435048ee583d4/users/cc265ab392ad4a87ab078fd16adb7614/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:18:48.953459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:48.956183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:48.957098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:49.021626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] MFA Rules not processed for user `cc265ab392ad4a87ab078fd16adb7614`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:18:49.023578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:49.094732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1028/2066] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:18:49.106393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:49.108218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:49.161828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3886e-fbaf-48a3-b9eb-15513d09912c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:49.165645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:49.166350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:49.166627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:49.166903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:49.224350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:49.225840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:49.238046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1039/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:53.754017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:53.763408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3a4f-10c7-413f-8e35-035f51e78871 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:53.766978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:53.767681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:53.768018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:53.768348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:53.777694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:53.779149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:53.788521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1029/2068] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:18:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:18:59.784037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:18:59.785595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:18:59.853306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90a81c-9d09-465f-ac77-a74cae484ce9 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:18:59.858712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:18:59.859600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:18:59.859881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:18:59.860152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] PATH_INFO: `/v3/users/1a796c88305745049007e4b578fdaf21` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:18:59.861532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a796c88305745049007e4b578fdaf21)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:18:59.863515 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:18:59.915016 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a796c88305745049007e4b578fdaf21'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:59.923733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a796c88305745049007e4b578fdaf21'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:59.924886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a796c88305745049007e4b578fdaf21'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:59.925682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a796c88305745049007e4b578fdaf21'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:59.939429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-098f0122-d58e-4dfe-aa86-2ecc051d1d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a796c88305745049007e4b578fdaf21'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:18:59.951587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1040/2069] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:18:59 2022] DELETE /identity/v3/users/1a796c88305745049007e4b578fdaf21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:00.140941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.157357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ecbe-8a15-486b-85f5-8347202d04ab service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.248514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.249510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.249887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.250391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] PATH_INFO: `/v3/projects/8a10e45107a64ade9bec7c825fe362bc` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.251940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a10e45107a64ade9bec7c825fe362bc)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.254239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.311646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a10e45107a64ade9bec7c825fe362bc', 'request_id': 'req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:00.328814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a10e45107a64ade9bec7c825fe362bc', 'request_id': 'req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:00.338743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a10e45107a64ade9bec7c825fe362bc', 'request_id': 'req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:00.355305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] The token cache is being invalidate because project 8a10e45107a64ade9bec7c825fe362bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:00.355628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:00.356385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f8227b3d-3819-4cf2-bfde-63c0795fa2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:00.358190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1030/2070] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:00 2022] DELETE /identity/v3/projects/8a10e45107a64ade9bec7c825fe362bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:00.363353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.363664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.363934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.384477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:00.385665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:00.450885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1041/2071] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:00.460124 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.460603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.460877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.488967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:00.490441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:00.501597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1031/2072] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:00.506150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.516828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695feaf7-4ef6-4107-910b-b35ffd86d311 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.527083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.527799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.528078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.528350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.529085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:00.529403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.530994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.550281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1042/2073] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:00.554919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.565034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4029a5-022e-4bee-a9f5-8f9af4af5c45 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.569958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.570701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.570977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.571245 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.572066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.573970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.604137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1032/2074] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:00 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:00.608715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.619604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18557-4af5-4f5b-92da-8ad9f20a758b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.687812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.688577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.688924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.689318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.690083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.692261 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.716941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1043/2075] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:00 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:00.721107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.731935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fffb8-0431-44ef-9150-f81e7e2507e0 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.746311 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.747360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.747643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.747918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.748658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.750547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.764194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1033/2076] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:00.771451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.783465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8f159-5bd8-4cec-bcec-31b7907bedaf admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.787550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.788208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.788992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.788992 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.789648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.791337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032936-9360-4743-9f74-1cf82f1467e1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.803533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1044/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:00.807656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:00.820988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d44b9-af32-43e8-a9fb-b111e7333529 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:00.827576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:00.829422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.831117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.832105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] PATH_INFO: `/v3/projects/e4862c44aef14c88b10bc9032602f568/users/a4a75d74a5984f378050886ac06a53fd/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.868098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4862c44aef14c88b10bc9032602f568, user_id=a4a75d74a5984f378050886ac06a53fd, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:00.873752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:00.900319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1034/2078] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:00 2022] PUT /identity/v3/projects/e4862c44aef14c88b10bc9032602f568/users/a4a75d74a5984f378050886ac06a53fd/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:00.905606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:00.905960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:00.906392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:00.925159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:00.926535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.007302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1045/2079] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:01.019181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:01.020975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.078964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f502ae-23f7-4d47-b703-2f83e681a343 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:01.082605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:01.083250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:01.083548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:01.083984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:01.093366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:01.094853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6255ee-7c17-4f40-b354-ead440fe3888 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:01.104468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1035/2080] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:01.662402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:01.664119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.676435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef64b6-9100-4504-a71d-f0629068ba67 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:01.681863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:01.682772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:01.683042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:01.683463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] PATH_INFO: `/v3/users/bb63d42ebef246d88700f90a28e0e2e7` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:01.685075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb63d42ebef246d88700f90a28e0e2e7)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:01.687829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:01.709961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:01.710507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:01.710507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:01.737997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] MFA Rules not processed for user `a4a75d74a5984f378050886ac06a53fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:01.739329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.748773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb63d42ebef246d88700f90a28e0e2e7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:01.759625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb63d42ebef246d88700f90a28e0e2e7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:01.760583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb63d42ebef246d88700f90a28e0e2e7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:01.761448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb63d42ebef246d88700f90a28e0e2e7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:01.774685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-97a1f8b8-7077-4c06-946d-f1b827a9e9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb63d42ebef246d88700f90a28e0e2e7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:01.788211 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1046/2081] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:01 2022] DELETE /identity/v3/users/bb63d42ebef246d88700f90a28e0e2e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:01.794286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:01.794576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:01.794849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:01.812868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:01.814047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.817316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1036/2082] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:01.823223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:01.824618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.841433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9fccd-a644-465c-8eb0-162d26b68c09 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:01.888462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1047/2083] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:01.901165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:01.903583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:01.922909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:01.923725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:01.924107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:01.924482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:01.925867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:01.928872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:01.965759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1037/2084] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:01 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:01.967138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975318a-1b7b-4661-9d29-2eb97ffdfadd None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:01.970110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.036628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.037536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.037796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.038174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.058618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bed84f-f4fd-4f05-be77-275419f74c25 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.064797 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.066131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.066820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.067362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.068216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.070929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.110338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1038/2085] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:01 2022] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:02.111855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.128117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21d36-824b-4734-ad60-bf1d92a3b13d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.137620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.141204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.153627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.154435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1048/2086] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:02.165824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.168367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.168699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.169703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.171383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.200895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1039/2087] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:02.209788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.240760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b20b-4ba7-4f34-8235-efc421854410 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.249393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.251148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.251689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.252292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] PATH_INFO: `/v3/projects/db607c0767f2474a8fddeafe75edafb3/users/bc985c488e7c4250b72d4540e3651878/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.273311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db607c0767f2474a8fddeafe75edafb3, user_id=bc985c488e7c4250b72d4540e3651878, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.276408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.311422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1049/2088] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:02 2022] PUT /identity/v3/projects/db607c0767f2474a8fddeafe75edafb3/users/bc985c488e7c4250b72d4540e3651878/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:02.312436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.323104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3ac04-7af4-46fd-8228-6c628e6a3dba admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.392457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.393739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.393739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.394071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.394691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.396425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.413696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1040/2089] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:02.418027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.429519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5717751-0fc3-4e69-96cc-ca5eb7093152 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.434924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.436303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.436843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.437196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] PATH_INFO: `/v3/projects/db607c0767f2474a8fddeafe75edafb3/users/bc985c488e7c4250b72d4540e3651878/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.439566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db607c0767f2474a8fddeafe75edafb3, user_id=bc985c488e7c4250b72d4540e3651878, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.442280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e123525-3c70-4089-a694-204cc9df7589 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.453517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1050/2090] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:02 2022] PUT /identity/v3/projects/db607c0767f2474a8fddeafe75edafb3/users/bc985c488e7c4250b72d4540e3651878/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:02.496987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.499192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:02.515477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad44a75-71f0-4a51-9768-c240c8188c32 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.588989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.590310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.590310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.590669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] PATH_INFO: `/v3/projects/072b3945908d417aa93f236beea03dc8` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.591809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072b3945908d417aa93f236beea03dc8)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.594080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.659758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072b3945908d417aa93f236beea03dc8', 'request_id': 'req-87c6b1d1-6df3-47f0-acee-7e45bb791d06'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:02.668730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072b3945908d417aa93f236beea03dc8', 'request_id': 'req-87c6b1d1-6df3-47f0-acee-7e45bb791d06'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:02.674301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072b3945908d417aa93f236beea03dc8', 'request_id': 'req-87c6b1d1-6df3-47f0-acee-7e45bb791d06'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:02.687789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] The token cache is being invalidate because project 072b3945908d417aa93f236beea03dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:02.688250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:02.689183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-87c6b1d1-6df3-47f0-acee-7e45bb791d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:02.690871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1041/2091] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:02 2022] DELETE /identity/v3/projects/072b3945908d417aa93f236beea03dc8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:02.695735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.696011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.696277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.717951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:02.719359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:02.780338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1051/2092] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:02.788446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.788973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.789086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.814453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:02.815691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:02.824793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1042/2093] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:02.828938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.839008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c86ef2-7813-4ef7-b155-2539c170cfc4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.843985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.844657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.844934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.845193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.845933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:02.846235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.848014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.861935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1052/2094] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:19:02.866798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.876832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db639c-523f-4889-b534-521a19ea2d77 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.881634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.882941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.883436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.883940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.884875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.887303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:02.916619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1043/2095] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:02 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:02.920650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:02.930540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff416-4bb6-4476-af00-79b6ed3b482d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:02.985927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:02.986736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:02.987164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:02.987494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:02.988217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:02.990356 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.014173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1053/2096] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:02 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:03.015611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.026237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04519d-bcc7-42aa-a34d-15c1bca62d8f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.032025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.032707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.032968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.033237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.033964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.035617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.047562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1044/2097] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:03.051707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.062504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162815-bd68-4c0e-ad16-00615ee3a746 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.068060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.068730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.069004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.069287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.070000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.071651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a2b79-bdd9-4af0-a7ae-154ee81b027d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.085931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1054/2098] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:03.087475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.108469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51c8-ccfa-4840-921b-0163dfa8a575 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.117112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.120004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.120732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.121978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] PATH_INFO: `/v3/projects/d019b2fd38f44fb193bf76b419634a16/users/5410f46266e048f399e60fd3f2d565d1/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.151023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985718-5118-412c-b7be-a06d467508f3 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.151023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985718-5118-412c-b7be-a06d467508f3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.151502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985718-5118-412c-b7be-a06d467508f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.164684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d019b2fd38f44fb193bf76b419634a16, user_id=5410f46266e048f399e60fd3f2d565d1, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.169223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c0a5-1397-4588-85b7-19bf71a5e174 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.189935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-52985718-5118-412c-b7be-a06d467508f3 None None] MFA Rules not processed for user `bc985c488e7c4250b72d4540e3651878`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:03.191256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-52985718-5118-412c-b7be-a06d467508f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.200382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1045/2099] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:03 2022] PUT /identity/v3/projects/d019b2fd38f44fb193bf76b419634a16/users/5410f46266e048f399e60fd3f2d565d1/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:03.206046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.207870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.208473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.236323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:03.238439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.332606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1055/2100] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:03.332606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985718-5118-412c-b7be-a06d467508f3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.341571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-52985718-5118-412c-b7be-a06d467508f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.363804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1046/2101] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:03.382926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.384649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.456825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea832-81a9-421d-894b-4c90fb254f37 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.460958 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.461616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.461887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.462297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.474087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.476855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61b592-af79-4f18-84a6-039c93b10593 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.484926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985718-5118-412c-b7be-a06d467508f3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.491544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1047/2102] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:03.494863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.495913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.496478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.497073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] PATH_INFO: `/v3/users/3809e80f36f7430ab36cb7b48ea358af` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.499423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3809e80f36f7430ab36cb7b48ea358af)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.501359 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.608788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3809e80f36f7430ab36cb7b48ea358af'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:03.619649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3809e80f36f7430ab36cb7b48ea358af'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:03.620516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3809e80f36f7430ab36cb7b48ea358af'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:03.621357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3809e80f36f7430ab36cb7b48ea358af'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:03.640467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3809e80f36f7430ab36cb7b48ea358af'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:03.659625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1056/2103] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:03 2022] DELETE /identity/v3/users/3809e80f36f7430ab36cb7b48ea358af => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:03.665751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.666472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.666962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.697296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:03.700220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.826912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1048/2104] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:03.839582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:03.843015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:03.943323 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b298-818f-4b76-ba39-9f0a315d109d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:03.947671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:03.948320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:03.948622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:03.949480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:03.958670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:03.960095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:03.970920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1057/2105] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:04.246193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:04.248086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:04.270672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8781ed-3fda-4872-aca7-4c97a2e01e0d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:04.279008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:04.280051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:04.280258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:04.280575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] PATH_INFO: `/v3/projects/299b3adb7f5e47d4a8add78a581ff0f9` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:04.282496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] RBAC: Authorizing `identity:delete_project(project_id=299b3adb7f5e47d4a8add78a581ff0f9)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:04.284432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:04.384407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299b3adb7f5e47d4a8add78a581ff0f9', 'request_id': 'req-1e7b2599-dc04-4a1b-92f2-319f2e07950f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.392326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299b3adb7f5e47d4a8add78a581ff0f9', 'request_id': 'req-1e7b2599-dc04-4a1b-92f2-319f2e07950f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.399378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299b3adb7f5e47d4a8add78a581ff0f9', 'request_id': 'req-1e7b2599-dc04-4a1b-92f2-319f2e07950f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.431279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] The token cache is being invalidate because project 299b3adb7f5e47d4a8add78a581ff0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:04.431779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.432821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1e7b2599-dc04-4a1b-92f2-319f2e07950f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.435346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1049/2106] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:04 2022] DELETE /identity/v3/projects/299b3adb7f5e47d4a8add78a581ff0f9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:04.439553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:04.452150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4b9c-c4c9-45c5-a70c-8595743466ba service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:04.516339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:04.517254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:04.517613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:04.517951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] PATH_INFO: `/v3/users/b5c22f522f7749fe9634d4f5bb1735f5` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:04.519253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c22f522f7749fe9634d4f5bb1735f5)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:04.521310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:04.575462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c22f522f7749fe9634d4f5bb1735f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.586341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c22f522f7749fe9634d4f5bb1735f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.587259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c22f522f7749fe9634d4f5bb1735f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.587942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c22f522f7749fe9634d4f5bb1735f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.601811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c22f522f7749fe9634d4f5bb1735f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:04.616506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1058/2107] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:04 2022] DELETE /identity/v3/users/b5c22f522f7749fe9634d4f5bb1735f5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:04.887252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:04.887852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:04.887852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:04.966846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] MFA Rules not processed for user `5410f46266e048f399e60fd3f2d565d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:04.968204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.086279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1050/2108] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:05.099668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.101321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.125248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.127230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.180110 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6ef7-53a0-49d9-aca2-a16b3bbafb42 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.184743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.186299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.186566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.186842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.197342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.199756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.211049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1059/2109] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:05.222989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.227938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.287886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745012b-e4d9-4270-844f-bd152fc55a1b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.299048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.300100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.300391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.300671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] PATH_INFO: `/v3/users/a4a75d74a5984f378050886ac06a53fd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.302414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a75d74a5984f378050886ac06a53fd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.307945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.340693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27acef-38e3-4113-8527-571b692ec498 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.346668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.347744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.348280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.348389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] PATH_INFO: `/v3/projects/b056de3372764829838ae148ee9606de` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.349545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b056de3372764829838ae148ee9606de)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.351508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.359596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a75d74a5984f378050886ac06a53fd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.366348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a75d74a5984f378050886ac06a53fd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.367010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a75d74a5984f378050886ac06a53fd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.377785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a75d74a5984f378050886ac06a53fd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.391551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-64e78c02-b6bb-4533-bb86-1737da796d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a75d74a5984f378050886ac06a53fd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.397559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1051/2110] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:05 2022] DELETE /identity/v3/users/a4a75d74a5984f378050886ac06a53fd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:05.405100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b056de3372764829838ae148ee9606de', 'request_id': 'req-b5011df1-7508-4275-8ae6-f372edbb5a48'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.411406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b056de3372764829838ae148ee9606de', 'request_id': 'req-b5011df1-7508-4275-8ae6-f372edbb5a48'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.420213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b056de3372764829838ae148ee9606de', 'request_id': 'req-b5011df1-7508-4275-8ae6-f372edbb5a48'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.432984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] The token cache is being invalidate because project b056de3372764829838ae148ee9606de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:05.433314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.434029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5011df1-7508-4275-8ae6-f372edbb5a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.436082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1060/2111] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:05 2022] DELETE /identity/v3/projects/b056de3372764829838ae148ee9606de => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:05.440774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.441078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.441390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.461293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:05.463310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.543664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1052/2112] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:05.545661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.545954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.546231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.565850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:05.567094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.585572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1061/2113] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:05.589970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.604885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa17f-6c3d-48d6-bc6d-6a126c19a1b8 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.605236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.609170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.618940 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.620746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.620746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.621216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.622601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:05.623041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.625419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.628845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60ab8-7539-44f7-8b4d-4ed6c504ddd5 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.635704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.636597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.637392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.637758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] PATH_INFO: `/v3/projects/e4862c44aef14c88b10bc9032602f568` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.639307 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4862c44aef14c88b10bc9032602f568)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.641733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.642044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1053/2114] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:05.646459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.656236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f6b3-a729-4742-996a-ffcde42c61d7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.662056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.662780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.663061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.663326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.664017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.665923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.688947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4862c44aef14c88b10bc9032602f568', 'request_id': 'req-f18f8d8a-d5d6-4bed-83be-d1188be29e34'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.692370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1054/2115] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:05.694370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4862c44aef14c88b10bc9032602f568', 'request_id': 'req-f18f8d8a-d5d6-4bed-83be-d1188be29e34'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.696396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.703986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4862c44aef14c88b10bc9032602f568', 'request_id': 'req-f18f8d8a-d5d6-4bed-83be-d1188be29e34'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.716781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] The token cache is being invalidate because project e4862c44aef14c88b10bc9032602f568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:05.717066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.718649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.720668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1062/2116] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:05 2022] DELETE /identity/v3/projects/e4862c44aef14c88b10bc9032602f568 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:05.724329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.725682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.759490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09603-7403-4acb-815c-8e8a922f3757 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.764618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.765356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.765731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.766068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.766854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.768848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.791229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1055/2117] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:05 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:05.791572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8d8a-d5d6-4bed-83be-d1188be29e34 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.795128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.797291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.798418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.799316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.799597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.799868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] PATH_INFO: `/v3/users/bc985c488e7c4250b72d4540e3651878` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.801118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc985c488e7c4250b72d4540e3651878)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.803031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.809820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4c3f-d934-4282-86dd-cfcf522e2c04 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.814424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.815090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.815394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.815649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.816381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.818003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.831024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1056/2118] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:05.834566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.846494 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c491-cdde-4501-9803-6e29d69c1b03 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.851756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.852477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.852752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.853022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.853816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.856181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.856300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc985c488e7c4250b72d4540e3651878'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.865125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc985c488e7c4250b72d4540e3651878'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.866032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc985c488e7c4250b72d4540e3651878'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.866741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc985c488e7c4250b72d4540e3651878'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.867866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1057/2119] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:05.872356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:05.874371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:05.880532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-33e6eda7-4423-4649-9e13-d4429f77dec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc985c488e7c4250b72d4540e3651878'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:05.891313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727dd3f-b558-4325-a4fc-20e7c7e68cc3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:05.893019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1063/2120] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:05 2022] DELETE /identity/v3/users/bc985c488e7c4250b72d4540e3651878 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:05.947267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:05.948168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.948449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.948718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] PATH_INFO: `/v3/projects/47d08d105ab14304a5f486a3c50fcfa8/users/361238394b7940eea9a65c6cee01be8d/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:05.962941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d08d105ab14304a5f486a3c50fcfa8, user_id=361238394b7940eea9a65c6cee01be8d, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:05.965616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:05.979479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1058/2121] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:05 2022] PUT /identity/v3/projects/47d08d105ab14304a5f486a3c50fcfa8/users/361238394b7940eea9a65c6cee01be8d/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:05.989958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:05.990244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:05.990541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.017920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] MFA Rules not processed for user `361238394b7940eea9a65c6cee01be8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.019164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.066368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.068739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.093686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1064/2122] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:06.098046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.134758 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d69e-9cab-4160-9c14-377607bb48ed admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.139848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.140737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.141019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.141290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] PATH_INFO: `/v3/projects/db607c0767f2474a8fddeafe75edafb3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.142497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db607c0767f2474a8fddeafe75edafb3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.144431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.156839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571463a9-88d2-445c-adac-cd8471058e15 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.161873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.162657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.162940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.163253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.163930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.165888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.189385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db607c0767f2474a8fddeafe75edafb3', 'request_id': 'req-7395b4a5-c914-42da-9943-5c520978c2c9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:06.190761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1065/2123] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:06.194691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.196158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db607c0767f2474a8fddeafe75edafb3', 'request_id': 'req-7395b4a5-c914-42da-9943-5c520978c2c9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:06.202270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db607c0767f2474a8fddeafe75edafb3', 'request_id': 'req-7395b4a5-c914-42da-9943-5c520978c2c9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:06.216807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] The token cache is being invalidate because project db607c0767f2474a8fddeafe75edafb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:06.217119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:06.217814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-7395b4a5-c914-42da-9943-5c520978c2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:06.223928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1059/2124] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:06 2022] DELETE /identity/v3/projects/db607c0767f2474a8fddeafe75edafb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:06.224287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cea2c-fbf4-4856-9643-134a6bb56db4 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.224576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cea2c-fbf4-4856-9643-134a6bb56db4 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.224853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cea2c-fbf4-4856-9643-134a6bb56db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.242759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a30cea2c-fbf4-4856-9643-134a6bb56db4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.244000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a30cea2c-fbf4-4856-9643-134a6bb56db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.256537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9014b-74a3-49c8-98c5-beb49cedb723 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.261242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.261907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.262186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.262487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.263171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.265096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.285338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1066/2125] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:06.289111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.290939 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.303003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b02e2-69d8-460e-ac7c-5770540e2d80 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.303135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1060/2126] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:06.311348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.311659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.311830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.315038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.316292 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.316574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.317358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.318092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.319950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.330861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1067/2127] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:06.334044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.334877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.335428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.348407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35d588-9e91-4dc8-b97d-303d3f64cbaa admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.351069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1061/2128] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:06.355168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.363364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.364940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.365222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.365493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.366223 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.367877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.373399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7584-e869-4872-90de-d450226ad700 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.378412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.379099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.379367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.379639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.380509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:06.380817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.382455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.386118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1068/2129] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:06.391215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.395975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1062/2130] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:19:06.399967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.403679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b75cf-d9c0-4f17-b414-fbc0144e08d8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.409931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.410085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a492-b121-4c9e-a476-028a6d74f50b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.410880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.411156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.411957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] PATH_INFO: `/v3/projects/bb9d953a947745c8b673ea07bb05563e/users/83e8232147af4b8b8266b5d6bb4023d6/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.417047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.417702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.418076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.418400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.419089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.421114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.429056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9d953a947745c8b673ea07bb05563e, user_id=83e8232147af4b8b8266b5d6bb4023d6, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.433498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747c19e-16b8-4c10-9383-08b03a75e853 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.451425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1069/2131] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:06 2022] PUT /identity/v3/projects/bb9d953a947745c8b673ea07bb05563e/users/83e8232147af4b8b8266b5d6bb4023d6/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:06.462810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.463100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.463376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.464445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1063/2132] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:06.468846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.508880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] MFA Rules not processed for user `83e8232147af4b8b8266b5d6bb4023d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.510228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.549795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3a2e3-e44d-4f41-a37f-d4be1c058d83 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.560391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.561065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.561410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.561617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.562471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.564449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.583567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1070/2133] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:06.583567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.597015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ff97-822b-4d00-89ee-9f4e0225b951 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.602396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.603331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.603760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.604132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.604952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.607060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.617147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1064/2134] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:06.619176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.640789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa6bc-6fa7-4417-a509-eb04bdc4749b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.641040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1071/2135] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:06.647777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.704842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.705600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.705883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.706162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.706980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.708598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e64b8-f965-4689-891e-d75f41abd55b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.718410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1065/2136] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:06.719855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.720121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.720407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.722460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad804-ec77-415d-b5a7-35fb56337f8d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.727592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.728293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.728575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.728845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.729663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.731726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.737973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] MFA Rules not processed for user `5410f46266e048f399e60fd3f2d565d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.739212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.755299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1072/2137] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:06.755299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.762916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ddeb-ecaa-49cb-9e4b-45716cbeed21 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.767535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.768171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.768451 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.768727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.769458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.771120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.784055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1073/2138] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:06.784055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.791354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e14c38-ef4d-4f0c-9a3f-c97a5d31b303 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.795960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1066/2139] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:06.796104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.796583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.796741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.797046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.797317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.798061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.799689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.810706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1074/2140] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:06.812316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527245c1-b87a-4c62-b22c-a3eaf83ec53e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.815096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.817723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.818730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.819078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.819415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] PATH_INFO: `/v3/projects/a1664f2bd9fa4f2d9002a7ff24a8de64/users/55c76297b46743058a97eea5d7ba414e/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.825915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdfb8-b1d5-4208-8762-6a691f6e9fa4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:06.830763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:06.831683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.831948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.832218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] PATH_INFO: `/v3/projects/b88524033e824d93a04339456bb18f67/users/f7cfd09880c0438ca267506c9ef1a4c4/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.835500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1664f2bd9fa4f2d9002a7ff24a8de64, user_id=55c76297b46743058a97eea5d7ba414e, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.838283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.847083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88524033e824d93a04339456bb18f67, user_id=f7cfd09880c0438ca267506c9ef1a4c4, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:06.849844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797040e6-a1c7-445b-82a2-f6befe60d6fe admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:06.865732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1075/2142] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:06 2022] PUT /identity/v3/projects/b88524033e824d93a04339456bb18f67/users/f7cfd09880c0438ca267506c9ef1a4c4/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:06.866875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1067/2142] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:06 2022] PUT /identity/v3/projects/a1664f2bd9fa4f2d9002a7ff24a8de64/users/55c76297b46743058a97eea5d7ba414e/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:06.870310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:06.870599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:06.870744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:06.871075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:06.918091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] MFA Rules not processed for user `55c76297b46743058a97eea5d7ba414e`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:06.919593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:06.945332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b268a89-3a6e-48e2-be57-526963ee30d3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.003702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1076/2143] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:07.008290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.012205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.012887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.013174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.013449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.014392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.016315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.027217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1068/2144] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:07.027914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b8a95-bf50-4d56-a161-938a03cfcf30 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.031745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.034937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.035615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.035893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.036162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.036855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.038867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.045845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7242-8b20-4536-87ca-d80488313694 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.052772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.053866 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.054513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.054925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] PATH_INFO: `/v3/projects/b88524033e824d93a04339456bb18f67/users/f7cfd09880c0438ca267506c9ef1a4c4/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.057216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88524033e824d93a04339456bb18f67, user_id=f7cfd09880c0438ca267506c9ef1a4c4, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.060410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e25f4b-070e-4260-a494-d2ac01c9caaf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.074312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1077/2145] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:07 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:07.075974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.082829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1069/2146] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:07 2022] PUT /identity/v3/projects/b88524033e824d93a04339456bb18f67/users/f7cfd09880c0438ca267506c9ef1a4c4/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:07.103573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.103861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.104187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.132182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] MFA Rules not processed for user `f7cfd09880c0438ca267506c9ef1a4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:07.133532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:07.151622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f447f7-d595-4513-8e9f-196dcf741091 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.156827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.157505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.158085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.158085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.158761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.160682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.186220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1078/2147] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:07 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:07.190199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.200392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fd48c-38dc-41b4-825c-808683c7a4d6 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.205985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.206838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.207364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.210722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.211513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.213176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.223719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1079/2148] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:07.227696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.237519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32362-681e-4b4a-8d11-ad776cb7f3ba admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.242729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1070/2149] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:07.246135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.247485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.247863 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.248238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] PATH_INFO: `/v3/projects/2bc2991609ea4db0bed846d1ef847a11/users/88e8bb6c4b7149f09f37dbee6dd17652/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.250970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.252386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:07.268642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc2991609ea4db0bed846d1ef847a11, user_id=88e8bb6c4b7149f09f37dbee6dd17652, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.271988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.295256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1080/2150] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:07 2022] PUT /identity/v3/projects/2bc2991609ea4db0bed846d1ef847a11/users/88e8bb6c4b7149f09f37dbee6dd17652/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:07.300066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.337460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17992aa0-9eec-42d2-86cd-b5e45ccf71da None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.386743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5490596-cccb-4a99-b084-5f136b62f414 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.393241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.393972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.394401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.394558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.395868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.397487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.412417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1081/2151] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:07.417782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.424432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.425158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.425443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.425719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.437012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f34f-419d-4e0c-bcb8-8b25677affcb admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.446757 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.447696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.447960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.448237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] PATH_INFO: `/v3/projects/2bc2991609ea4db0bed846d1ef847a11/users/88e8bb6c4b7149f09f37dbee6dd17652/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.450726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc2991609ea4db0bed846d1ef847a11, user_id=88e8bb6c4b7149f09f37dbee6dd17652, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.453828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc134c3-f2d7-4e80-b705-4f55103328ed admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.488632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1082/2152] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:07 2022] PUT /identity/v3/projects/2bc2991609ea4db0bed846d1ef847a11/users/88e8bb6c4b7149f09f37dbee6dd17652/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:07.490329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.491754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.492259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.524993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] MFA Rules not processed for user `88e8bb6c4b7149f09f37dbee6dd17652`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:07.526197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:07.566109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.567897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.586455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1071/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:07.630120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1083/2154] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:07.641341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:07.642793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:07.656518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293c6df-f3f6-4708-ba83-1330d1e1172e service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:07.764965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:07.768112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:07.769033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:07.770085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:07.806638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:07.811715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593249d4-202b-47a8-ab91-2243f7c60b7f service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:07.838728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1072/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:08.575601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:08.586075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c8c15-e0a7-44be-a42b-ca4c24e2f6de None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:08.592605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:08.593313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:08.593871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:08.594403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:08.597092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:08.662891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:08.664346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:08.676374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1084/2156] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:08.950402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e29a-a016-42c7-b098-07a4bc30c0ab None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:08.951659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e29a-a016-42c7-b098-07a4bc30c0ab None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:08.952135 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e29a-a016-42c7-b098-07a4bc30c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:08.993597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6ee1e29a-a016-42c7-b098-07a4bc30c0ab None None] MFA Rules not processed for user `3f1cedefc7254a4797b7d6ca461a065c`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:08.995616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6ee1e29a-a016-42c7-b098-07a4bc30c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:09.088816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1073/2157] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:09.713551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:09.781544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1645-6148-422e-90fa-46c85cbf811c service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:09.789320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:09.791114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:09.791495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:09.791867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] PATH_INFO: `/v3/users/55c76297b46743058a97eea5d7ba414e` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:09.793903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c76297b46743058a97eea5d7ba414e)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:09.797257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:09.870444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c76297b46743058a97eea5d7ba414e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:09.883671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c76297b46743058a97eea5d7ba414e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:09.884827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c76297b46743058a97eea5d7ba414e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:09.885732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c76297b46743058a97eea5d7ba414e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:09.932894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c76297b46743058a97eea5d7ba414e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:09.958445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1085/2158] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:09 2022] DELETE /identity/v3/users/55c76297b46743058a97eea5d7ba414e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:09.960107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:09.960558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:09.960657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:09.981146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:09.982783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:10.097122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1074/2159] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:10.140433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:10.143556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:10.263922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf45f2-35c2-4973-8609-01075466421c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:10.269346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:10.270639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:10.270928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:10.271205 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:10.285136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:10.288393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:10.312609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1086/2160] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:11.127215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:11.128612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:11.140416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a81e31-9ec2-43ee-932a-28de0ada31a5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:11.145729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:11.146701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:11.146921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:11.147192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] PATH_INFO: `/v3/projects/a1664f2bd9fa4f2d9002a7ff24a8de64` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:11.148417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1664f2bd9fa4f2d9002a7ff24a8de64)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:11.150349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:11.222837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1664f2bd9fa4f2d9002a7ff24a8de64', 'request_id': 'req-a7cadf6c-2857-4174-a96d-7f043b98e953'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.230444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1664f2bd9fa4f2d9002a7ff24a8de64', 'request_id': 'req-a7cadf6c-2857-4174-a96d-7f043b98e953'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.236690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1664f2bd9fa4f2d9002a7ff24a8de64', 'request_id': 'req-a7cadf6c-2857-4174-a96d-7f043b98e953'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.251242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] The token cache is being invalidate because project a1664f2bd9fa4f2d9002a7ff24a8de64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:11.251526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.252170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.253916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1075/2161] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:11 2022] DELETE /identity/v3/projects/a1664f2bd9fa4f2d9002a7ff24a8de64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:11.258111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:11.268477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021df0-b119-4e5a-b47f-410f763de0d4 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:11.329263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:11.330457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:11.330794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:11.331120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] PATH_INFO: `/v3/users/88e8bb6c4b7149f09f37dbee6dd17652` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:11.332360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e8bb6c4b7149f09f37dbee6dd17652)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:11.334414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:11.404693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e8bb6c4b7149f09f37dbee6dd17652'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.419969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e8bb6c4b7149f09f37dbee6dd17652'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.420646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e8bb6c4b7149f09f37dbee6dd17652'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.421684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e8bb6c4b7149f09f37dbee6dd17652'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.434968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e8bb6c4b7149f09f37dbee6dd17652'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.447980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1087/2162] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:11 2022] DELETE /identity/v3/users/88e8bb6c4b7149f09f37dbee6dd17652 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:11.790293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:11.791599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:11.805451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cadf6c-2857-4174-a96d-7f043b98e953 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:11.849471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:11.851315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:11.879495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:11.880580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:11.880933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:11.881285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] PATH_INFO: `/v3/projects/2bc2991609ea4db0bed846d1ef847a11` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:11.883001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc2991609ea4db0bed846d1ef847a11)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:11.884999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:11.933557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bea415-59b4-4a30-ac39-715cce1f9878 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:11.945555 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc2991609ea4db0bed846d1ef847a11', 'request_id': 'req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.952674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc2991609ea4db0bed846d1ef847a11', 'request_id': 'req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.958159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc2991609ea4db0bed846d1ef847a11', 'request_id': 'req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.972558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] The token cache is being invalidate because project 2bc2991609ea4db0bed846d1ef847a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:11.972846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.973479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-db35d1e4-b97d-4b96-beb4-3c9c5244f4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:11.977607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1076/2163] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:11 2022] DELETE /identity/v3/projects/2bc2991609ea4db0bed846d1ef847a11 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:11.983167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d5d1-f4ae-4063-a01a-266910f74cbf None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:11.983529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d5d1-f4ae-4063-a01a-266910f74cbf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:11.983875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d5d1-f4ae-4063-a01a-266910f74cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.010690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.011635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.011914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.013128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] PATH_INFO: `/v3/users/1a6c3e536c17486b91d199b0c838db27` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.014828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6c3e536c17486b91d199b0c838db27)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.017277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.020214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4ee1d5d1-f4ae-4063-a01a-266910f74cbf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:12.021660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4ee1d5d1-f4ae-4063-a01a-266910f74cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.032951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1077/2164] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:12.040735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.041358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.041685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.064644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:12.065832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.071715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6c3e536c17486b91d199b0c838db27'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.074462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1078/2165] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:12.079537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.083520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6c3e536c17486b91d199b0c838db27'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.084737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6c3e536c17486b91d199b0c838db27'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.085138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6c3e536c17486b91d199b0c838db27'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.089994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4f5a5-b2e7-4412-9850-2671b91c5c05 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.097405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.098171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.098486 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.098754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.099637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6c3e536c17486b91d199b0c838db27'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.099773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:12.099943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.101528 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.125981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1079/2166] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:19:12.131185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.133855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1088/2167] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:11 2022] DELETE /identity/v3/users/1a6c3e536c17486b91d199b0c838db27 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:12.135292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.150757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca1290-8905-452e-99c0-73e2956738b7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.211287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.212477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.212827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.213154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.214343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.216652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.251612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1080/2168] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:12.252806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.264158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1f85-776d-4891-836d-b44d6f5f87ff admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.341230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.342058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.342411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.342688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.343904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.346893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.378523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1089/2169] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:12.379869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.390717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662bdb3-39a1-4200-a30f-a0e65f5d0fd8 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.397429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.398112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.398467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.398760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.399499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.401142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.413761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1081/2170] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:12.418064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.439905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-760e-414e-855b-96785a410246 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.448877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.449597 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.449872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.450144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.450918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.452673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.457839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.459704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.463365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1090/2171] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:12.467443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.477302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747602-f35b-4aff-9b28-ba25103f98a2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.478473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895adbec-6008-45a8-833b-b1ecbe3e2c69 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.483944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.485052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.485581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.485825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.486034 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] PATH_INFO: `/v3/projects/fbd642c7ab8b4749b75c45a09a6c62ac/users/f92bbca32f3c4ecbaddee39eb201d191/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.487054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.487935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.488359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] PATH_INFO: `/v3/projects/ee9e66b971ab4f29b88b2400d280fe75` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.491203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9e66b971ab4f29b88b2400d280fe75)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.493931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.504951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd642c7ab8b4749b75c45a09a6c62ac, user_id=f92bbca32f3c4ecbaddee39eb201d191, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.508040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555fcc1-457f-496e-8fba-9ec3063da2c2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.526836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1091/2172] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:12 2022] PUT /identity/v3/projects/fbd642c7ab8b4749b75c45a09a6c62ac/users/f92bbca32f3c4ecbaddee39eb201d191/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:12.538976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.539276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.539603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.560565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9e66b971ab4f29b88b2400d280fe75', 'request_id': 'req-58528be2-cad6-492a-8b88-7bdd525b653b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.572167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9e66b971ab4f29b88b2400d280fe75', 'request_id': 'req-58528be2-cad6-492a-8b88-7bdd525b653b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.573525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] MFA Rules not processed for user `f92bbca32f3c4ecbaddee39eb201d191`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:12.574836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.578545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9e66b971ab4f29b88b2400d280fe75', 'request_id': 'req-58528be2-cad6-492a-8b88-7bdd525b653b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.594004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] The token cache is being invalidate because project ee9e66b971ab4f29b88b2400d280fe75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:12.595072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.595900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.597645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1082/2173] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:12 2022] DELETE /identity/v3/projects/ee9e66b971ab4f29b88b2400d280fe75 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:12.601882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.603450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.644153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1092/2174] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:12.649216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.652341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.685733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528be2-cad6-492a-8b88-7bdd525b653b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.691088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.692012 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.692321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.692596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] PATH_INFO: `/v3/users/cc265ab392ad4a87ab078fd16adb7614` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.693994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc265ab392ad4a87ab078fd16adb7614)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.695996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.731229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771efd8-c423-400e-8260-ee32751cc3e4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.762753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.765231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.765522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.765689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc265ab392ad4a87ab078fd16adb7614'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.765876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.766991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.768898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:12.772749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc265ab392ad4a87ab078fd16adb7614'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.773491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc265ab392ad4a87ab078fd16adb7614'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.784100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc265ab392ad4a87ab078fd16adb7614'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.802116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc265ab392ad4a87ab078fd16adb7614'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:12.805267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1093/2175] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/projects => generated 399 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:12.816625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1083/2176] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:12 2022] DELETE /identity/v3/users/cc265ab392ad4a87ab078fd16adb7614 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:12.816816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.816816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.909604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597640f-211c-4970-8e78-2aedf0f97b42 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:12.948009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:12.949779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:12.993730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:12.994620 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:12.994972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:12.995357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:12.997159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:12.999861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.021955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5e693-7f77-4dba-b7d6-2270a5bfe1fe admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.026346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.027526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.027810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.028100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.031584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1094/2177] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:12 2022] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:13.034702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.037548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.055933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf939ff-a6a4-4100-824b-f99ca1952bf0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.068501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.069186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.069467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.069789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.070601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.072270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.083741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1095/2178] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:13.084746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.087022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.101959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d601e-8d42-4247-93e2-8ad3709007e0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.107494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.108360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.108638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.108907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] PATH_INFO: `/v3/projects/9dfbe0a654e9419abb4435048ee583d4` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.110072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfbe0a654e9419abb4435048ee583d4)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.112003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.113388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.115914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.126858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1084/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:13.127646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.139979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea02f4-f07b-4f0d-807d-0c91e3d6cbbd service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.146841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.148263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.148598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.149115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] PATH_INFO: `/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6/users/cfcf53d933bd4269b664bd685514b066/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.169794 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c53c42ae2964d2c9cd5835ae5327ee6, user_id=cfcf53d933bd4269b664bd685514b066, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.173778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.182558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfbe0a654e9419abb4435048ee583d4', 'request_id': 'req-cda06630-667e-41ac-a694-6b0784e84aa7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:13.189321 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfbe0a654e9419abb4435048ee583d4', 'request_id': 'req-cda06630-667e-41ac-a694-6b0784e84aa7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:13.194301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1085/2180] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:13 2022] PUT /identity/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6/users/cfcf53d933bd4269b664bd685514b066/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:13.201793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfbe0a654e9419abb4435048ee583d4', 'request_id': 'req-cda06630-667e-41ac-a694-6b0784e84aa7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:13.210001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.218331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] The token cache is being invalidate because project 9dfbe0a654e9419abb4435048ee583d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:13.218942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:13.220386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cda06630-667e-41ac-a694-6b0784e84aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:13.222590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1096/2181] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:13 2022] DELETE /identity/v3/projects/9dfbe0a654e9419abb4435048ee583d4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:13.228876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7e32-37ec-4b6b-9f01-17aa318f82e8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.229782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7e32-37ec-4b6b-9f01-17aa318f82e8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.230166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7e32-37ec-4b6b-9f01-17aa318f82e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.255112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2f4e7e32-37ec-4b6b-9f01-17aa318f82e8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:13.256470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2f4e7e32-37ec-4b6b-9f01-17aa318f82e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.292970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd1c2-5e25-4e6c-8bc3-295659918ab3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.298295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.298702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.298980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.299334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.300035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.301913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.315755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1086/2182] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:13.319907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.322757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.336529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1097/2183] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:13.341138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cb03e-29f3-4bd6-b208-27047de9bc88 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.344811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.345801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.346103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.352162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.353321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.353603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.353880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] PATH_INFO: `/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6/users/cfcf53d933bd4269b664bd685514b066/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.356429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c53c42ae2964d2c9cd5835ae5327ee6, user_id=cfcf53d933bd4269b664bd685514b066, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.360443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414633e-77c1-4b08-a0aa-00c1388c5abd admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.374729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:13.385609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.385802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1087/2184] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:13 2022] PUT /identity/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6/users/cfcf53d933bd4269b664bd685514b066/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:13.391613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.392241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.392642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.450116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] MFA Rules not processed for user `cfcf53d933bd4269b664bd685514b066`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:13.452776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.500196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1098/2185] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:13.501864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.513230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260638e4-47a0-44a4-bcba-959d818675b7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.519487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.520651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.521409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.522089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.523218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:13.523696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.525551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.547984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1099/2186] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:13.549031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.560177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fcd79-327f-4b01-863a-63b3e5b6d8a3 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.579155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.582677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.582976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.583254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.586723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.592103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.599196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1088/2187] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:13.608849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.610790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:13.652170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1100/2188] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:13 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:13.656500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.684179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef187-2d72-4d21-9a3b-e80631cea8e7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.742186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.743175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.744084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.744561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.793532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36667-1e2e-4c9e-8984-4a35a1a0888e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.814048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.814791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.815066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.815344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.816031 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.817962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.838118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.840345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.847080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1101/2189] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:13 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:13.849047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.862639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef2e11-5284-455e-aef4-fab2bff48966 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.865716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1089/2190] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:13.869409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.870194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.870617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.870971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.872060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.873997 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.887438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1102/2191] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:13.891580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.908006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f427a2-2ea2-4a3a-9179-1eafbd66879d service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:13.940520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:13.943734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:13.945210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:13.945824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:13.950730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:13.956567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:13.976480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1090/2192] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:13.980571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:13.995438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e351-7ced-48af-a0d6-0d6e9ab28da7 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:14.003746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:14.004990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:14.005275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:14.005600 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] PATH_INFO: `/v3/projects/69ca58f4d1524f4e99d0966289330ea7/users/d8147af6ecd44d5aba4f31f27c3a8743/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:14.009813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:14.011612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:14.026037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ca58f4d1524f4e99d0966289330ea7, user_id=d8147af6ecd44d5aba4f31f27c3a8743, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:14.028037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d837a7a-4b33-43e8-85bb-5875ec85647d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:14.028815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efdd43-2d87-4267-9cfd-d1c7e8fee60b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:14.032489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:14.034838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:14.035209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:14.036051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:14.038302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:14.052598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1103/2193] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:13 2022] PUT /identity/v3/projects/69ca58f4d1524f4e99d0966289330ea7/users/d8147af6ecd44d5aba4f31f27c3a8743/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:14.064293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:14.065156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:14.065487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:14.107453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] MFA Rules not processed for user `d8147af6ecd44d5aba4f31f27c3a8743`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:14.108770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:14.121343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:14.123269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:14.134998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1091/2194] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:14.183066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1104/2195] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:14.191368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:14.193035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:14.275393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c242-945d-4660-b7aa-bcda319e1fb1 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:14.327348 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:14.328150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:14.328531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:14.329031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:14.340657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:14.342881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac324d-42d0-4931-965b-456c2e6b4166 service glance] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:14.355074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1092/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:15.558999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:15.560520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:15.645715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc813a9-4c46-4211-8c35-2aa2c1662c34 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:15.651014 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:15.651919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:15.652230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:15.652501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] PATH_INFO: `/v3/users/361238394b7940eea9a65c6cee01be8d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:15.653697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=361238394b7940eea9a65c6cee01be8d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:15.655665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:15.706965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361238394b7940eea9a65c6cee01be8d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:15.714989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361238394b7940eea9a65c6cee01be8d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:15.715738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361238394b7940eea9a65c6cee01be8d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:15.716594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361238394b7940eea9a65c6cee01be8d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:15.728448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361238394b7940eea9a65c6cee01be8d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:15.741618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1105/2197] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:15 2022] DELETE /identity/v3/users/361238394b7940eea9a65c6cee01be8d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:15.745959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:15.746640 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:15.747270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:15.764886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:15.766006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:15.834020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1093/2198] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:15.843877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:15.845332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:15.900954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0447349-678b-4dde-a3d6-b52e9ef448fa admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:15.905666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:15.906649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:15.906952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:15.907165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:15.919353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:15.920779 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:15.929977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1106/2199] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:16.330297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:16.330654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:16.349697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466ab42-0bce-4609-86d8-262effd80963 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:16.354800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:16.355716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:16.356006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:16.356401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] PATH_INFO: `/v3/projects/47d08d105ab14304a5f486a3c50fcfa8` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:16.357617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d08d105ab14304a5f486a3c50fcfa8)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:16.359595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:16.418552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d08d105ab14304a5f486a3c50fcfa8', 'request_id': 'req-78daa56f-d5ff-4f3f-8f61-d45b183a2797'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.424721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d08d105ab14304a5f486a3c50fcfa8', 'request_id': 'req-78daa56f-d5ff-4f3f-8f61-d45b183a2797'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.429993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d08d105ab14304a5f486a3c50fcfa8', 'request_id': 'req-78daa56f-d5ff-4f3f-8f61-d45b183a2797'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.443999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] The token cache is being invalidate because project 47d08d105ab14304a5f486a3c50fcfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:16.444284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.444951 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.446650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1094/2200] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:16 2022] DELETE /identity/v3/projects/47d08d105ab14304a5f486a3c50fcfa8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:16.450984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:16.460958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27f68-44cc-49b3-a06f-9fd32949b84a service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:16.521213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:16.522339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:16.522623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:16.522914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] PATH_INFO: `/v3/users/83e8232147af4b8b8266b5d6bb4023d6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:16.524238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e8232147af4b8b8266b5d6bb4023d6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:16.526178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:16.574235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e8232147af4b8b8266b5d6bb4023d6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.581961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e8232147af4b8b8266b5d6bb4023d6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.582611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e8232147af4b8b8266b5d6bb4023d6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.583220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e8232147af4b8b8266b5d6bb4023d6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.595003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e8232147af4b8b8266b5d6bb4023d6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:16.607015 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1107/2201] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:16 2022] DELETE /identity/v3/users/83e8232147af4b8b8266b5d6bb4023d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:16.889102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:16.890680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:16.930459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daa56f-d5ff-4f3f-8f61-d45b183a2797 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:16.997972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:16.999312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:17.002637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:17.004115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] PATH_INFO: `/v3/projects/bb9d953a947745c8b673ea07bb05563e` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:17.006765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9d953a947745c8b673ea07bb05563e)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:17.009358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:17.060935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9d953a947745c8b673ea07bb05563e', 'request_id': 'req-e0e28e1b-7870-4bda-a823-cd7395672bb5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.067319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9d953a947745c8b673ea07bb05563e', 'request_id': 'req-e0e28e1b-7870-4bda-a823-cd7395672bb5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.075594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9d953a947745c8b673ea07bb05563e', 'request_id': 'req-e0e28e1b-7870-4bda-a823-cd7395672bb5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.089323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] The token cache is being invalidate because project bb9d953a947745c8b673ea07bb05563e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:17.089696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.090356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.091948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1095/2202] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:16 2022] DELETE /identity/v3/projects/bb9d953a947745c8b673ea07bb05563e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:17.096063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:17.097481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:17.110380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f775-f4df-4422-ad2d-42fd68931965 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:17.169527 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:17.170446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:17.170732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:17.171008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] PATH_INFO: `/v3/users/f7cfd09880c0438ca267506c9ef1a4c4` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:17.172197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cfd09880c0438ca267506c9ef1a4c4)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:17.174225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:17.223533 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cfd09880c0438ca267506c9ef1a4c4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.232185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cfd09880c0438ca267506c9ef1a4c4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.232943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cfd09880c0438ca267506c9ef1a4c4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.233632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cfd09880c0438ca267506c9ef1a4c4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.245448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-23769e18-7bd6-491f-8a3a-5cefac98f910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cfd09880c0438ca267506c9ef1a4c4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:17.257683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1108/2203] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:17 2022] DELETE /identity/v3/users/f7cfd09880c0438ca267506c9ef1a4c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:17.874214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:17.875843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:17.889448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28e1b-7870-4bda-a823-cd7395672bb5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:17.946020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:17.946927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:17.947207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:17.947479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] PATH_INFO: `/v3/projects/b88524033e824d93a04339456bb18f67` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:17.948745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88524033e824d93a04339456bb18f67)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:17.950790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:17.999349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88524033e824d93a04339456bb18f67', 'request_id': 'req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.005306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88524033e824d93a04339456bb18f67', 'request_id': 'req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.010551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88524033e824d93a04339456bb18f67', 'request_id': 'req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.023669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] The token cache is being invalidate because project b88524033e824d93a04339456bb18f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:18.023985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.024614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a44396d0-80fb-4e44-aa83-dc2c4f6c2c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.026229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1096/2204] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:17 2022] DELETE /identity/v3/projects/b88524033e824d93a04339456bb18f67 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:18.032181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.032651 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.032747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.051530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:18.052728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.111776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1109/2205] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:18.120625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.120914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.121192 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.141732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:18.142993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.151715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1097/2206] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:18.156024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.169577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee8d7-9f7b-4b86-939a-21b543ef0944 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.175793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.176465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.176790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.186400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.187275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:18.187588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.189277 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.202280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1110/2207] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:18.206304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.215826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0f84e-e653-4dca-ab0d-1ae9bd3266fd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.224764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.225909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.226415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.226896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.228337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.231335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.269783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1098/2208] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:18.274047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.284450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d851722-d1f3-4c57-897f-764a05002147 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.338743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.340616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.350655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.351334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.351617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.351892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.352595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.354545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.380541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1111/2209] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:18.383477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.395617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a11d7-0b1b-4b39-8196-bde3313aeed4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.404639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.404928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.405229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.405554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.406485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.408878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.409111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de483303-4b91-458d-8238-def86ca585b6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.417741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.418892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.419173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.419449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] PATH_INFO: `/v3/users/f92bbca32f3c4ecbaddee39eb201d191` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.420846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92bbca32f3c4ecbaddee39eb201d191)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.421564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1112/2210] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:18.422997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.425280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.436013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ba37a-9e19-47b4-ad2b-5bc582063835 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.441178 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.441842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.442118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.442426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.443149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.444751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.461038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1113/2211] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:18.462123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.472662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaa4bd-efca-4bfa-b6d8-8cb445f13dad admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.478202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.479254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.479663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.479828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92bbca32f3c4ecbaddee39eb201d191'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.480115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] PATH_INFO: `/v3/projects/fa59d063de5e43dfa932a47faa2e44af/users/0d30eeee506643b09213c315a9c283c3/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.488539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92bbca32f3c4ecbaddee39eb201d191'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.489508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92bbca32f3c4ecbaddee39eb201d191'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.499390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa59d063de5e43dfa932a47faa2e44af, user_id=0d30eeee506643b09213c315a9c283c3, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.501052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92bbca32f3c4ecbaddee39eb201d191'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.502184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d69a0a-a83c-45ff-8d08-2efe36d96ca4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.516303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2a9cdb82-ccf8-42ca-b680-dd513ab6f163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92bbca32f3c4ecbaddee39eb201d191'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.516503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1114/2212] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:18 2022] PUT /identity/v3/projects/fa59d063de5e43dfa932a47faa2e44af/users/0d30eeee506643b09213c315a9c283c3/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:18.526151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1099/2213] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:18 2022] DELETE /identity/v3/users/f92bbca32f3c4ecbaddee39eb201d191 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:18.529639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.529834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.530188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.530412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.530602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.530817 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.550636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:18.552035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.563542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] MFA Rules not processed for user `0d30eeee506643b09213c315a9c283c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:18.564889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.616045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1115/2214] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:18.626194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.627582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.637343 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1100/2215] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:18.672029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.673482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.692009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340352f3-83a1-4f6f-9770-b2d18f46d108 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.696546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.697303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.697650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.698080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.715214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.716656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.726967 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1116/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:18.737318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efee49-357f-44f2-97a1-206ccb159658 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.741200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.741872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.742151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.742455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.753472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.755095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45548-de46-4091-a6c6-ba13dfd1a540 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.767298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1101/2217] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:18.783397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:18.785183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:18.797838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696465c9-b777-44e2-bad4-70272057b9b4 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:18.803109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:18.803953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.804237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.804511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] PATH_INFO: `/v3/users/0d30eeee506643b09213c315a9c283c3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.806147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d30eeee506643b09213c315a9c283c3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:18.809046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:18.885348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d30eeee506643b09213c315a9c283c3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.895250 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d30eeee506643b09213c315a9c283c3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.895884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d30eeee506643b09213c315a9c283c3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.896951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d30eeee506643b09213c315a9c283c3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.911224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d30eeee506643b09213c315a9c283c3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:18.926959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1117/2218] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:18 2022] DELETE /identity/v3/users/0d30eeee506643b09213c315a9c283c3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:18.931593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399073-6d45-40f1-b216-80123a22754f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:18.932090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399073-6d45-40f1-b216-80123a22754f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:18.932215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399073-6d45-40f1-b216-80123a22754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:18.971222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d6399073-6d45-40f1-b216-80123a22754f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:18.972615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d6399073-6d45-40f1-b216-80123a22754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.091569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1102/2219] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:19.101821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:19.103275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.163233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6399073-6d45-40f1-b216-80123a22754f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:19.165614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d6399073-6d45-40f1-b216-80123a22754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.188726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be5701-5f2b-49dd-afa3-c2d7bbda7e74 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:19.192640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:19.200682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.202318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.202754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.217997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6399073-6d45-40f1-b216-80123a22754f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:19.224649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:19.226103 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:19.229598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:19.230659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.231003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.231340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] PATH_INFO: `/v3/projects/fbd642c7ab8b4749b75c45a09a6c62ac` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.234186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd642c7ab8b4749b75c45a09a6c62ac)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:19.236246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:19.255590 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1118/2220] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:19.294647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd642c7ab8b4749b75c45a09a6c62ac', 'request_id': 'req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.304298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd642c7ab8b4749b75c45a09a6c62ac', 'request_id': 'req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.309835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd642c7ab8b4749b75c45a09a6c62ac', 'request_id': 'req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.321671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] The token cache is being invalidate because project fbd642c7ab8b4749b75c45a09a6c62ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:19.322183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.322859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.324721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1103/2221] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:19 2022] DELETE /identity/v3/projects/fbd642c7ab8b4749b75c45a09a6c62ac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:19.328691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:19.344421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39653975-32cb-4369-8bae-2b2aa2b8af82 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:19.400754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:19.401657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.401936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.402235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] PATH_INFO: `/v3/users/cfcf53d933bd4269b664bd685514b066` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.403517 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcf53d933bd4269b664bd685514b066)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:19.405526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:19.453733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcf53d933bd4269b664bd685514b066'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.462973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcf53d933bd4269b664bd685514b066'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.463759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcf53d933bd4269b664bd685514b066'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.464929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcf53d933bd4269b664bd685514b066'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.477538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcf53d933bd4269b664bd685514b066'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.490505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1119/2222] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:19 2022] DELETE /identity/v3/users/cfcf53d933bd4269b664bd685514b066 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:19.739942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:19.741906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.755493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147a21-e5e8-46fd-9c2f-2fc0da164f1e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:19.776788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:19.779276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.842879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:19.844087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.844362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.844628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] PATH_INFO: `/v3/projects/fa59d063de5e43dfa932a47faa2e44af` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.845814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa59d063de5e43dfa932a47faa2e44af)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:19.847764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:19.862710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8725b7-447a-4529-a063-e3c803560620 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:19.867596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:19.868484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.868747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.869023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] PATH_INFO: `/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.870427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c53c42ae2964d2c9cd5835ae5327ee6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:19.873025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:19.908477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa59d063de5e43dfa932a47faa2e44af', 'request_id': 'req-95ed2384-c8c8-4319-8636-76c9ca86e4f9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.915318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa59d063de5e43dfa932a47faa2e44af', 'request_id': 'req-95ed2384-c8c8-4319-8636-76c9ca86e4f9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.921417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa59d063de5e43dfa932a47faa2e44af', 'request_id': 'req-95ed2384-c8c8-4319-8636-76c9ca86e4f9'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.928591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c53c42ae2964d2c9cd5835ae5327ee6', 'request_id': 'req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.934930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c53c42ae2964d2c9cd5835ae5327ee6', 'request_id': 'req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.935487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] The token cache is being invalidate because project fa59d063de5e43dfa932a47faa2e44af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:19.935950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.936424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-95ed2384-c8c8-4319-8636-76c9ca86e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.941359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1104/2223] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:19 2022] DELETE /identity/v3/projects/fa59d063de5e43dfa932a47faa2e44af => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:19.943970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f31fd-9625-4105-8a2c-10488a9e0fbe None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.944305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f31fd-9625-4105-8a2c-10488a9e0fbe None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.944714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f31fd-9625-4105-8a2c-10488a9e0fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:19.947666 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c53c42ae2964d2c9cd5835ae5327ee6', 'request_id': 'req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.964662 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f67f31fd-9625-4105-8a2c-10488a9e0fbe None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:19.965960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f67f31fd-9625-4105-8a2c-10488a9e0fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:19.969234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] The token cache is being invalidate because project 0c53c42ae2964d2c9cd5835ae5327ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:19.969602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.971360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a7c4d2a9-df4f-4e74-9e42-edd78ed02eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:19.973406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1120/2224] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:19 2022] DELETE /identity/v3/projects/0c53c42ae2964d2c9cd5835ae5327ee6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:19.984144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:19.986401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:19.986732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.012445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:20.013920 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:20.061462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1105/2225] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:20.068768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb03cc-bd22-4d57-ad4a-507c14da4569 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.069317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb03cc-bd22-4d57-ad4a-507c14da4569 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.069820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb03cc-bd22-4d57-ad4a-507c14da4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.095902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-56bb03cc-bd22-4d57-ad4a-507c14da4569 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:20.097997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-56bb03cc-bd22-4d57-ad4a-507c14da4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:20.108746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1121/2226] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:20.110356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1106/2227] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:20.114569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.120968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.121246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.121665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.132446 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc68830-a66a-4efd-9e90-aae6d509329f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.145957 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.147086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.147649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.148025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.150984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:20.151443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.153448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.153823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:20.155046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:20.167009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1107/2228] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:20.170637 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1122/2229] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:20.174375 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.174834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.184915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afaa6-0980-4988-968f-335eb1a60756 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.189991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61381c89-9607-4874-bd92-4026c0bef930 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.190246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.191080 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.191496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.191932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.192781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:20.193237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.195185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.206634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.207405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.207728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.207987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.208771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.211306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.217046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1108/2230] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:19:20.217962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.231227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac471c-b4d3-4558-8306-44c88845573c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.236631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.237477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.238237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.238972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.239638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.242694 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.260146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1123/2231] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:20.262119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.291116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1109/2232] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:20.296257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.376884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcd5b-f57d-4a45-96ba-775d9776f9b9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.380428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6f04-1cf2-4546-90c6-d82173311ed5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.381959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.382766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.383147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.383537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.384312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.386460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.387331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.388198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.388645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.389067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.389914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.392234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.414696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1124/2233] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:20.419000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.419653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1110/2234] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:20.425734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.431330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b15ee-f48a-426b-a664-de37de1bb4b6 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.436481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.437936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.438139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3568f-71a4-4c77-979b-38a34bf36e33 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.438247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.438539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.439288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.441011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.443240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.443886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.444306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.444428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.445180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.447020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.462229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1125/2235] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:20.462492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1111/2236] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:20.463624 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.463850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.474163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594345a6-b990-418f-a296-1a561e5f2646 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.474422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541acb5-3d18-4202-927e-8040895c0e84 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.479490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.479893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.480157 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.480504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.480777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.480867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.481182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.481502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.481618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.482705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.483145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.484106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.493815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1112/2237] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:20.495619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1126/2238] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:20.498413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.500245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.511258 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fa8f5-5575-4558-b0e0-a3e5a36c84dc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.512118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419b52-430d-48ff-ac50-c0f950fccc68 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.516154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.516911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.517032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.517313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.517625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] PATH_INFO: `/v3/projects/cc8307c991704a6eb4bd103208405265/users/09b56f033c6b47a78ecff89d99c8fb25/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.517806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.518088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.518404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] PATH_INFO: `/v3/projects/51c3334ff7e24a25b5fa4e68200eb9b6/users/c4d6a45837194a658975e71af3984645/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.532677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8307c991704a6eb4bd103208405265, user_id=09b56f033c6b47a78ecff89d99c8fb25, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.532906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c3334ff7e24a25b5fa4e68200eb9b6, user_id=c4d6a45837194a658975e71af3984645, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.535395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b517e-9643-47df-a514-57e9346fd686 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.535579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595f61e-ea5a-43f0-813f-06dbcd385c7c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.552773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1127/2239] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:20 2022] PUT /identity/v3/projects/51c3334ff7e24a25b5fa4e68200eb9b6/users/c4d6a45837194a658975e71af3984645/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:20.552990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1113/2240] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:20 2022] PUT /identity/v3/projects/cc8307c991704a6eb4bd103208405265/users/09b56f033c6b47a78ecff89d99c8fb25/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:20.561460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.561754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.562029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.564207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.564525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.564854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.587758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] MFA Rules not processed for user `09b56f033c6b47a78ecff89d99c8fb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:20.588980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:20.589977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] MFA Rules not processed for user `c4d6a45837194a658975e71af3984645`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:20.591198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:20.666684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1128/2241] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:20.666930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.667396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1114/2242] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:20.668638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.728804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cf66f-7129-49ce-970b-a339ea135cf0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.729024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30413ed-8453-4e72-82f3-61c316cfefdb None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.733549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.733741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.734210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.734436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.734526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.734774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.734871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.735123 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.735462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.735807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.737352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.737685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.763328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1129/2243] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:20.767275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1115/2244] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:20.767941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.769696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.834093 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8218-ff64-47ae-9c5c-10a427e68b0e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.836783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dec-3bfa-473f-956a-58210dc00528 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.839783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.840478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.840764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.841698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.842208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.842486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.842903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.843173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.843455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.844120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.845050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.846015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.867122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1116/2245] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:20.867691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1130/2246] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:20 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:20.875630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.876881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.886450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9e3a2-5c93-426c-baa6-cca5188a0563 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.888162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508a38-0b11-4043-97ec-3f413efb5ba8 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.891270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.891931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.892212 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.892483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.893908 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.894047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.894363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.894646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.894934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.895610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.895714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.897328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.913221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1117/2247] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:20.913417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1131/2248] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:20.913498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.916524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.924256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bb65-2ec8-4836-97aa-08e65bdb7e34 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.926945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db251518-5979-46aa-9d51-698c95a21650 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:20.929571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.930661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.930949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.931227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] PATH_INFO: `/v3/projects/26706f5dd5d74497b00086ba042f0a52/users/cdd8e8145a404f959cd47e91c415d33f/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.933004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:20.933903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:20.934183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:20.934488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] PATH_INFO: `/v3/projects/be2f530d1e6d4d5092b500a140ec5b05/users/743ff4bdee714a26af11cdd255c49294/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:20.946718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26706f5dd5d74497b00086ba042f0a52, user_id=cdd8e8145a404f959cd47e91c415d33f, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.949435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.957105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f530d1e6d4d5092b500a140ec5b05, user_id=743ff4bdee714a26af11cdd255c49294, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:20.959921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:20.980923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1118/2249] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:20 2022] PUT /identity/v3/projects/26706f5dd5d74497b00086ba042f0a52/users/cdd8e8145a404f959cd47e91c415d33f/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:20.984852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:20.985640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1132/2250] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:20 2022] PUT /identity/v3/projects/be2f530d1e6d4d5092b500a140ec5b05/users/743ff4bdee714a26af11cdd255c49294/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:20.989350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:21.051465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0fa11-04eb-4345-87e2-c5bc080a7963 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.055253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b532c-f786-41f5-93ed-3c2341168aa1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.056134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.056801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.057087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.057357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.058110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.059767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.060008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.060667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.060948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.061220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.061945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.063557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.069458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1119/2251] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:21.073157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1133/2252] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:21.074973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:21.077104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:21.087152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39bbd-9fcb-4b6e-b9ff-bf2c6e66b1e5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.091212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce616-8ba6-40a1-bc96-63fb821a4b6b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.091971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.092861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.093133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.093407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] PATH_INFO: `/v3/projects/be2f530d1e6d4d5092b500a140ec5b05/users/743ff4bdee714a26af11cdd255c49294/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.095509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f530d1e6d4d5092b500a140ec5b05, user_id=743ff4bdee714a26af11cdd255c49294, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.096540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.097488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.097836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.098172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] PATH_INFO: `/v3/projects/26706f5dd5d74497b00086ba042f0a52/users/cdd8e8145a404f959cd47e91c415d33f/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.098293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e435db-1914-4815-897a-9e30de9f93dd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.100249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26706f5dd5d74497b00086ba042f0a52, user_id=cdd8e8145a404f959cd47e91c415d33f, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.103740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db0f77-ce76-4423-9acb-449e516e8b68 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.109041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1134/2253] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:21 2022] PUT /identity/v3/projects/be2f530d1e6d4d5092b500a140ec5b05/users/743ff4bdee714a26af11cdd255c49294/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:21.119889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.120172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.120499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.126351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1120/2254] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:21 2022] PUT /identity/v3/projects/26706f5dd5d74497b00086ba042f0a52/users/cdd8e8145a404f959cd47e91c415d33f/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:21.131000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.131626 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.132344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.151315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] MFA Rules not processed for user `743ff4bdee714a26af11cdd255c49294`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:21.152545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:21.165215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] MFA Rules not processed for user `cdd8e8145a404f959cd47e91c415d33f`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:21.166752 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:21.246558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1135/2255] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:21.258071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1121/2256] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:21.259195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:21.260896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:21.269514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:21.270903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:21.327954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70dfcc-d2f9-46e9-a242-62c337a36616 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.331620 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e01ed9-74eb-43a4-98ef-a8f31b343dbe None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:21.331868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.332678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.332886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.333153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.335863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:21.336565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:21.337491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:21.337864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:21.392934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.394595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.404623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1136/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:21.407680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:21.409306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd15f3-2e9f-4794-9465-3084e3b196e9 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:21.419038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1122/2258] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:24.151684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:24.213483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a6d9-2540-4e8d-ad56-26c6cf15648f service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:24.218293 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:24.219195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:24.219473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:24.219744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] PATH_INFO: `/v3/users/09b56f033c6b47a78ecff89d99c8fb25` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:24.220935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b56f033c6b47a78ecff89d99c8fb25)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:24.222940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:24.269878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b56f033c6b47a78ecff89d99c8fb25'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.277186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b56f033c6b47a78ecff89d99c8fb25'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.277853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b56f033c6b47a78ecff89d99c8fb25'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.278495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b56f033c6b47a78ecff89d99c8fb25'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.289887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b56f033c6b47a78ecff89d99c8fb25'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.302971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1137/2259] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:24 2022] DELETE /identity/v3/users/09b56f033c6b47a78ecff89d99c8fb25 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:24.307717 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:24.308217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:24.308391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:24.326392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:24.327611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:24.402213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1123/2260] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:24.412246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:24.413667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:24.468469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926e20-7672-4fa2-a039-30ced74571c8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:24.472227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:24.472899 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:24.473182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:24.473574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:24.483525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:24.484958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:24.495072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1138/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:24.784998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:24.786548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:24.798493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d41c3-007b-452e-b755-f3fd81074f9d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:24.803336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:24.804216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:24.804490 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:24.804765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] PATH_INFO: `/v3/projects/cc8307c991704a6eb4bd103208405265` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:24.806051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8307c991704a6eb4bd103208405265)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:24.807979 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:24.852715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8307c991704a6eb4bd103208405265', 'request_id': 'req-6cb908f5-0882-43f2-a172-26424e3659c8'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.858707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8307c991704a6eb4bd103208405265', 'request_id': 'req-6cb908f5-0882-43f2-a172-26424e3659c8'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.864044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8307c991704a6eb4bd103208405265', 'request_id': 'req-6cb908f5-0882-43f2-a172-26424e3659c8'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.877883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] The token cache is being invalidate because project cc8307c991704a6eb4bd103208405265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:24.878171 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.878812 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:24.880475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1124/2262] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:24 2022] DELETE /identity/v3/projects/cc8307c991704a6eb4bd103208405265 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:24.884510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:24.894092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e2aea-c0fe-440e-bcb7-2a43629a8558 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:24.947616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:24.948494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:24.948772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:24.949262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] PATH_INFO: `/v3/users/743ff4bdee714a26af11cdd255c49294` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:24.950466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743ff4bdee714a26af11cdd255c49294)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:24.952373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:24.998220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743ff4bdee714a26af11cdd255c49294'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.006020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743ff4bdee714a26af11cdd255c49294'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.006638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743ff4bdee714a26af11cdd255c49294'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.007284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743ff4bdee714a26af11cdd255c49294'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.018725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-570a017b-f3b1-48cf-9e42-c2c91a53b081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743ff4bdee714a26af11cdd255c49294'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.030461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1139/2263] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:24 2022] DELETE /identity/v3/users/743ff4bdee714a26af11cdd255c49294 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:25.340380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.341919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:25.355537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb908f5-0882-43f2-a172-26424e3659c8 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.423719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.424597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.424878 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.425151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] PATH_INFO: `/v3/projects/be2f530d1e6d4d5092b500a140ec5b05` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.426385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2f530d1e6d4d5092b500a140ec5b05)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.428296 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.477177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2f530d1e6d4d5092b500a140ec5b05', 'request_id': 'req-3121bde0-9eac-425d-8b9a-f96221d480d7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.483766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2f530d1e6d4d5092b500a140ec5b05', 'request_id': 'req-3121bde0-9eac-425d-8b9a-f96221d480d7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.489481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2f530d1e6d4d5092b500a140ec5b05', 'request_id': 'req-3121bde0-9eac-425d-8b9a-f96221d480d7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.505771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] The token cache is being invalidate because project be2f530d1e6d4d5092b500a140ec5b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:25.506208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.506899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3121bde0-9eac-425d-8b9a-f96221d480d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:25.508444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1125/2264] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:25 2022] DELETE /identity/v3/projects/be2f530d1e6d4d5092b500a140ec5b05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:25.513317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.513803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.513905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.535170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:25.535170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:25.594233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1140/2265] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:25.602422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.602737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.603014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.622827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:25.624020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:25.633141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1126/2266] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:25.637395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.647963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee11fa-32d6-4d11-ad2a-cdf0266aa5bc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.653747 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.654456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.654734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.655001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.655736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:25.656039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.657646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.670696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1141/2267] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:25.675443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.684934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d888cc-1c94-4f0a-bbd0-0dd87b6519ee None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.689970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.690647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.690930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.691193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.691869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.693765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.719736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1127/2268] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:25 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:25.724196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.734911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f7ede-4065-4092-affd-052bc1a5c7d1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.798162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.798873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.799155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.799606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.800322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.802226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.822745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.827317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1142/2269] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:25 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:25.828320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:25.831242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.841993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56522-3b36-459d-b92e-8e763ef9b25b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.847683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.848399 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.850001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.850001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.850001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.851287 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.861534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1143/2270] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:25.865483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.876561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce8a-d5e2-4ec2-94d4-068358e50128 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.882397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.883229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.883509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.883782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.884506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.886083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.903639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605cb25-7a8b-44a5-a5bc-ff57634040ca admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.908840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1144/2271] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:25.910466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:25.910909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.911592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.911846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.912117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.914718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:25.921513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7523be-0a51-4240-8099-b3c3d7d8b6e5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:25.928084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:25.929515 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.929799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.930076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] PATH_INFO: `/v3/projects/59ab56f38dd74028b0a5eb3f4a70e029/users/6e56197b8c1c4ba6a3eef903787f316c/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:25.946730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ab56f38dd74028b0a5eb3f4a70e029, user_id=6e56197b8c1c4ba6a3eef903787f316c, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:25.949659 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ed4ae-ee52-4784-9d12-fca3a9a999df admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:25.968704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1145/2272] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:25 2022] PUT /identity/v3/projects/59ab56f38dd74028b0a5eb3f4a70e029/users/6e56197b8c1c4ba6a3eef903787f316c/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:25.979438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:25.979754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:25.980085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:26.006421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:26.007955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:26.014295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] MFA Rules not processed for user `6e56197b8c1c4ba6a3eef903787f316c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:26.015199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:26.019368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1128/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:26.236833 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1146/2274] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:26.247959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:26.249420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:26.260484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908967-0d3b-482d-b133-3314815f0029 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:26.340383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:26.341036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:26.341540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:26.341540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:26.350961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:26.352390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce081-e319-4558-bf1f-4c82d7bc9e64 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:26.362489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1129/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:29.446171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:29.517344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9b8a-ea5c-4456-991f-77eb8fb7c1bd None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:29.521630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:29.522556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:29.522823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:29.523089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] PATH_INFO: `/v3/users/6e56197b8c1c4ba6a3eef903787f316c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:29.524276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e56197b8c1c4ba6a3eef903787f316c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:29.526177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:29.583681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e56197b8c1c4ba6a3eef903787f316c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:29.592700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e56197b8c1c4ba6a3eef903787f316c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:29.593306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e56197b8c1c4ba6a3eef903787f316c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:29.594035 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e56197b8c1c4ba6a3eef903787f316c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:29.606462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e56197b8c1c4ba6a3eef903787f316c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:29.619164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1147/2276] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:29 2022] DELETE /identity/v3/users/6e56197b8c1c4ba6a3eef903787f316c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:29.623745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629285cf-2b30-4069-803f-f0188c46798c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:29.624291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629285cf-2b30-4069-803f-f0188c46798c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:29.624503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629285cf-2b30-4069-803f-f0188c46798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:29.645223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-629285cf-2b30-4069-803f-f0188c46798c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:29.646465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-629285cf-2b30-4069-803f-f0188c46798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:29.710457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1130/2277] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:29.718755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:29.720157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:29.775614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318bbe-c067-4d46-b426-f7928ce35a52 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:29.780500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:29.781179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:29.781424 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:29.781696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:29.792445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:29.793928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64acd-deba-4a99-afa6-e5b66a4aeb7e service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:29.803838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1148/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:30.091457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629285cf-2b30-4069-803f-f0188c46798c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.092947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-629285cf-2b30-4069-803f-f0188c46798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:30.105141 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629285cf-2b30-4069-803f-f0188c46798c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.110357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.111289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.111566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.111839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] PATH_INFO: `/v3/projects/59ab56f38dd74028b0a5eb3f4a70e029` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.114043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ab56f38dd74028b0a5eb3f4a70e029)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.116219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.162496 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ab56f38dd74028b0a5eb3f4a70e029', 'request_id': 'req-e5dc7173-1f04-42bc-adbb-dfc89be79e24'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:30.168600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ab56f38dd74028b0a5eb3f4a70e029', 'request_id': 'req-e5dc7173-1f04-42bc-adbb-dfc89be79e24'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:30.173912 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ab56f38dd74028b0a5eb3f4a70e029', 'request_id': 'req-e5dc7173-1f04-42bc-adbb-dfc89be79e24'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:30.191326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] The token cache is being invalidate because project 59ab56f38dd74028b0a5eb3f4a70e029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:30.191644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:30.192864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e5dc7173-1f04-42bc-adbb-dfc89be79e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:30.194957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1131/2279] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:30 2022] DELETE /identity/v3/projects/59ab56f38dd74028b0a5eb3f4a70e029 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:30.201552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.201808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.202102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.223734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:30.224949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:30.286086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1149/2280] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:30.293763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.294116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.294439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.313686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:30.314895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:30.323281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1132/2281] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:30.327574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.341707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d23f-b293-471f-9e8d-b84c9e10d7c2 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.346470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.347125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.347383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.347650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.348393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:30.348688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.350276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.365152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1150/2282] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:19:30.367061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.377937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5a62-122a-4e6d-9ba1-f0edf5b76445 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.383411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.384059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.384338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.384642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.385322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.387359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.415168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1133/2283] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:30.419388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.429771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf4ea-2d4f-4fff-8193-1bffcf0d9fb8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.486803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.487490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.487726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.487994 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.488771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.491135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.513726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1151/2284] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:30.518189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.530408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862d62e-713b-4674-9f08-22f715bcad88 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.535218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.535870 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.536259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.536411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.537158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.538791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.548916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1134/2285] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:30.553109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.563691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21a805-f00c-4496-b537-b2f239cc2d8f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.569230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.569890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.570165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.570464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.571195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.572789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66536bb5-d7be-4938-b951-1de3836d152a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.583630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1152/2286] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:30.588226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.598580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992018-8e6f-4d30-97f4-aa18fe1f0a3b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.604195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.605122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.605459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.605707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] PATH_INFO: `/v3/projects/06d210c7ef9d4fcda20b90be8570fe87/users/e379898197ba4995affb065c321306f0/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.621651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d210c7ef9d4fcda20b90be8570fe87, user_id=e379898197ba4995affb065c321306f0, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.624720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.639982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1135/2287] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:30 2022] PUT /identity/v3/projects/06d210c7ef9d4fcda20b90be8570fe87/users/e379898197ba4995affb065c321306f0/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:30.651525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.651811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.652083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.686842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] MFA Rules not processed for user `e379898197ba4995affb065c321306f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:30.688043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:30.752457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1153/2288] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:30.758404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.824971 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba27613-f360-4654-aba3-cfa6288cc9b1 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.829655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.830332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.830608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.831158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.831847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.833728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.864647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1136/2289] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:30.865936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.877735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ce1d3-3249-4e9d-8ad3-6ab8d3c72c21 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.931238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.931918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.932198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.932469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.933179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.935172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.957930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1154/2290] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:30 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:30.966437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:30.976590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0f9e3-c87d-4e3f-bca4-c01386a09447 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:30.981525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:30.982285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:30.982642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:30.982988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:30.984019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:30.985968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:30.997436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1137/2291] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:31.001530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.011744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f398b3d-abf9-473c-bda3-1a9418be3d0c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.019362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.021287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.023209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.023895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.024177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.024455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.025187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.030102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.035851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c44ba-5752-47ad-b3aa-0c04dd9b719c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.037885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1155/2292] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:31.041774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.042763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.043269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.043677 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.044121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] PATH_INFO: `/v3/users/c4d6a45837194a658975e71af3984645` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.045345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d6a45837194a658975e71af3984645)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.047616 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.054554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb227d2-1152-4836-97af-51d68c061500 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.059150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.060032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.060306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.060571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] PATH_INFO: `/v3/projects/bd9ea462b48c4240ac1d02ccd561d7d2/users/7cb4dd97242844e4a0cd038bf7ed874a/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.078102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9ea462b48c4240ac1d02ccd561d7d2, user_id=7cb4dd97242844e4a0cd038bf7ed874a, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.081330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e278c-4fdd-4605-91de-5781e3d953df admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.104348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1156/2293] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:31 2022] PUT /identity/v3/projects/bd9ea462b48c4240ac1d02ccd561d7d2/users/7cb4dd97242844e4a0cd038bf7ed874a/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:31.113652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d6a45837194a658975e71af3984645'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.116045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.116329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.116588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.123262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d6a45837194a658975e71af3984645'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.124196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d6a45837194a658975e71af3984645'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.135789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d6a45837194a658975e71af3984645'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.147112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] MFA Rules not processed for user `7cb4dd97242844e4a0cd038bf7ed874a`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:31.148362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.151448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4d2e4f03-0c5f-4522-bbc6-227ff4b20735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d6a45837194a658975e71af3984645'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.168856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1138/2294] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:31 2022] DELETE /identity/v3/users/c4d6a45837194a658975e71af3984645 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:31.168856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.168856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.168856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.186163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:31.187393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.227063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1157/2295] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:31.231978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.234164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.278767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1139/2296] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:31.296042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.299756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.325079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3818-8b75-403b-8c06-e3f055a4bf79 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.330877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.331644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.332052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.332414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.333358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.335559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.362859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1158/2297] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:31 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:31.366755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.377712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2908935-5cd0-4835-adaf-d64125418625 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.438859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.439807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.440198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.440964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.464163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c3cd-ee0a-4d89-8451-33a93175900e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.468928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.469694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.470042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.470412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.471164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.473137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.506540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1159/2298] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:31 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:31.507530 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.508289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.509739 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.521242 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1140/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:31.526691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242830e-3c0d-4026-86f1-f9507ba2f0db admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.531690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.532364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.532638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.532907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.533639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.535296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.550729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1160/2300] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:19:31.555378 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.566220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfee5b-742c-47c1-9752-78b0e0335950 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.571382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.572453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.572901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.573333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] PATH_INFO: `/v3/projects/1637e14248e44635a69e7ee5de6b5519/users/dbadf9f7780f4e81b9e110c5cb277db6/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.589248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1637e14248e44635a69e7ee5de6b5519, user_id=dbadf9f7780f4e81b9e110c5cb277db6, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.592368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.606223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1141/2301] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:31 2022] PUT /identity/v3/projects/1637e14248e44635a69e7ee5de6b5519/users/dbadf9f7780f4e81b9e110c5cb277db6/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:31.610139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.620317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e3fe-bd52-40c3-8c22-c4f8432664fe admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.690008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.690937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.691284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.691754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.692808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.697726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c00e0-7426-4fd5-8a69-1ae89270e10e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.709018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1161/2302] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:31.713038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.724262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8c06-5e8e-4eda-afc8-aa4a3f50371a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.729322 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.730396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.730680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.730953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] PATH_INFO: `/v3/projects/1637e14248e44635a69e7ee5de6b5519/users/dbadf9f7780f4e81b9e110c5cb277db6/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.733076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1637e14248e44635a69e7ee5de6b5519, user_id=dbadf9f7780f4e81b9e110c5cb277db6, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.735795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.746302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1142/2303] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:31 2022] PUT /identity/v3/projects/1637e14248e44635a69e7ee5de6b5519/users/dbadf9f7780f4e81b9e110c5cb277db6/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:31.756755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.757116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.757392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.787473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] MFA Rules not processed for user `dbadf9f7780f4e81b9e110c5cb277db6`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:31.788730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.802564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.804261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.875767 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1162/2304] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:31.885013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ab5-27fb-4756-a3c6-83bdae69b361 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.887219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.888573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.890463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.891326 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.891602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.891871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] PATH_INFO: `/v3/projects/51c3334ff7e24a25b5fa4e68200eb9b6` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:31.893089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c3334ff7e24a25b5fa4e68200eb9b6)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:31.895064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:31.944467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c3334ff7e24a25b5fa4e68200eb9b6', 'request_id': 'req-8f4a84ff-49d9-488d-b685-f3def0df9b36'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.945787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7b5e-f44d-4d55-b300-10fca6ef3662 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:31.955984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c3334ff7e24a25b5fa4e68200eb9b6', 'request_id': 'req-8f4a84ff-49d9-488d-b685-f3def0df9b36'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.963802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c3334ff7e24a25b5fa4e68200eb9b6', 'request_id': 'req-8f4a84ff-49d9-488d-b685-f3def0df9b36'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.978303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] The token cache is being invalidate because project 51c3334ff7e24a25b5fa4e68200eb9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:31.978589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.979250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:31.980835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1143/2305] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:31 2022] DELETE /identity/v3/projects/51c3334ff7e24a25b5fa4e68200eb9b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:19:31.984953 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:31.986532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:31.995644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:31.996381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:31.996680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:31.997254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.000670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:32.053086 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a84ff-49d9-488d-b685-f3def0df9b36 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:32.057602 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:32.058553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.058827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.059093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] PATH_INFO: `/v3/users/cdd8e8145a404f959cd47e91c415d33f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.060275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd8e8145a404f959cd47e91c415d33f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:32.060464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:32.062022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:32.062241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:32.070866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1163/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:19:32.110462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd8e8145a404f959cd47e91c415d33f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.120530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd8e8145a404f959cd47e91c415d33f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.121330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd8e8145a404f959cd47e91c415d33f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.131226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd8e8145a404f959cd47e91c415d33f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.144592 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b7aa32af-5164-4d59-a9b7-3c6cf4544da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd8e8145a404f959cd47e91c415d33f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.150774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1144/2307] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:31 2022] DELETE /identity/v3/users/cdd8e8145a404f959cd47e91c415d33f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:32.548713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:32.568804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634a7a-4822-4fcc-8185-29a7062a66ec service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:32.627900 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:32.628809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.629082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.629342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] PATH_INFO: `/v3/projects/26706f5dd5d74497b00086ba042f0a52` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.630581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26706f5dd5d74497b00086ba042f0a52)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:32.632684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:32.680199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26706f5dd5d74497b00086ba042f0a52', 'request_id': 'req-e1380258-466e-4abe-93af-e69f56379317'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.688581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26706f5dd5d74497b00086ba042f0a52', 'request_id': 'req-e1380258-466e-4abe-93af-e69f56379317'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.696672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26706f5dd5d74497b00086ba042f0a52', 'request_id': 'req-e1380258-466e-4abe-93af-e69f56379317'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.709430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] The token cache is being invalidate because project 26706f5dd5d74497b00086ba042f0a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:32.709711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.710389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e1380258-466e-4abe-93af-e69f56379317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:32.711936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1164/2308] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:32 2022] DELETE /identity/v3/projects/26706f5dd5d74497b00086ba042f0a52 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:32.719408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.720336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.720336 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.739035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:32.740214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:32.799563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1145/2309] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:32.808674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.808870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.809137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.829171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:32.830430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:32.839291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1165/2310] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:32.843731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:32.856074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796c6a4-1e73-4299-b7ee-ba3d579a75b3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:32.861365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:32.862029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.862315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.862618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.863347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:19:32.863657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:32.865268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:32.877337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1146/2311] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:19:32.882464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:32.892026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ccfeb-06e3-4a39-a52c-15b965e36a51 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:32.896917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:32.897574 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:32.897859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:32.898125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:32.898841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:32.900719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:32.929458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1166/2312] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:19:32 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:19:32.934930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:32.944871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780f25-3331-469c-938e-379230b87849 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.003183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.003846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.004125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.004396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.005094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.007037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:33.027955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1147/2313] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:19:32 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:19:33.032238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:33.043012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de6c1e-d23c-4a7c-9a9d-0db8f9581108 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.048667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.049334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.049611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.049880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.050640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.052237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:33.063636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1167/2314] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:33.067772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:33.078791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16b5a-ffbb-49d3-96b5-e17f88882dd9 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.084901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.085582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.085887 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.086155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.086927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.088534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3cdf-bdec-447a-b8d8-5a144e706744 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:33.099120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1148/2315] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:19:33.103422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:33.114280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffebd-49aa-45d0-acc3-3dc621f90f7f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.119551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.120447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.120725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.120996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] PATH_INFO: `/v3/projects/b13047c9554a42dba3b68d84f19ecf10/users/2c87fb221dac452cba7a34a24cc045d3/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.136507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13047c9554a42dba3b68d84f19ecf10, user_id=2c87fb221dac452cba7a34a24cc045d3, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.139199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:33.152965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1168/2316] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:19:33 2022] PUT /identity/v3/projects/b13047c9554a42dba3b68d84f19ecf10/users/2c87fb221dac452cba7a34a24cc045d3/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:33.165771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.166084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.166405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.192931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] MFA Rules not processed for user `2c87fb221dac452cba7a34a24cc045d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:33.194132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:33.263249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1149/2317] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:33.275125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:33.277428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:33.336552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14852-5a0b-4e36-9d78-cdf7481fa7d8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.341455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.342116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.342441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.342676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.352626 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.354045 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:33.362864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1169/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:33.911237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:33.923697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd56c-3ac8-495c-8bc5-9f26ce202c5f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:33.928443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:33.929082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:33.929361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:33.929635 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:33.931895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:33.993424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:33.994924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd10561-b503-4d78-8583-311de584c1c7 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:34.005212 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1150/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:34.564134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:34.573595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa5a5-e84a-488d-90d5-acfa7786b57e service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:34.578101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:34.578769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:34.579047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:34.579314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:34.581460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:34.652906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:34.654358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:34.664062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1170/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:42.530650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:42.531164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:42.531315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:42.550538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:42.551768 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:42.612531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1151/2321] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:19:42.661783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:42.663262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:42.735043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08b3c8-8825-41f6-a929-5e0fe36ad068 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:42.742011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:42.743311 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:42.743595 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:42.743883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:42.755129 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:42.756768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6e2e-6d5f-46d2-a9c1-9b9635b3cd25 service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:42.765275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1171/2322] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:19:42.770898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:42.772813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:42.845418 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5062-e19b-4125-912c-7e972d1a4781 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:42.850519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:42.851438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:42.851734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:42.851980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] PATH_INFO: `/v3/users/e379898197ba4995affb065c321306f0` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:42.854151 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e379898197ba4995affb065c321306f0)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:42.856335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:42.914077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e379898197ba4995affb065c321306f0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:42.926485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e379898197ba4995affb065c321306f0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:42.927534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e379898197ba4995affb065c321306f0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:42.936158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e379898197ba4995affb065c321306f0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:42.948039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e379898197ba4995affb065c321306f0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:42.954269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1152/2323] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:42 2022] DELETE /identity/v3/users/e379898197ba4995affb065c321306f0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:42.958816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:42.959102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:42.959393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:42.977316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:19:42.978598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:43.064753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1172/2324] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:19:43.079836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:43.081901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:43.172278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609511d6-ffc2-4bb7-b66e-814955451a7f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:43.187170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:43.187869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:43.188232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:43.189956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:43.220633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:43.222116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:43.259083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1153/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:19:43.586801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:43.588217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:43.600627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e585e1-f2b5-465b-a2fa-70f394166cd0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:43.605717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:43.606774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:43.607192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:43.607472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] PATH_INFO: `/v3/projects/06d210c7ef9d4fcda20b90be8570fe87` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:43.608723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d210c7ef9d4fcda20b90be8570fe87)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:43.610685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:43.660692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d210c7ef9d4fcda20b90be8570fe87', 'request_id': 'req-4be9229c-f33f-4204-a59b-23d2bc96a30b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.667466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d210c7ef9d4fcda20b90be8570fe87', 'request_id': 'req-4be9229c-f33f-4204-a59b-23d2bc96a30b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.676803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d210c7ef9d4fcda20b90be8570fe87', 'request_id': 'req-4be9229c-f33f-4204-a59b-23d2bc96a30b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.691060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] The token cache is being invalidate because project 06d210c7ef9d4fcda20b90be8570fe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:43.691461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.692199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.693923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1173/2326] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:43 2022] DELETE /identity/v3/projects/06d210c7ef9d4fcda20b90be8570fe87 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:43.698298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:43.708454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eb7dc-8c65-4ec1-b859-ceb853380bad service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:43.790960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:43.790960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:43.790960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:43.790960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] PATH_INFO: `/v3/users/7cb4dd97242844e4a0cd038bf7ed874a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:43.792716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb4dd97242844e4a0cd038bf7ed874a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:43.795731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:43.846715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb4dd97242844e4a0cd038bf7ed874a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.853282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb4dd97242844e4a0cd038bf7ed874a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.853973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb4dd97242844e4a0cd038bf7ed874a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.861209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb4dd97242844e4a0cd038bf7ed874a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.873176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb4dd97242844e4a0cd038bf7ed874a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:43.879094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1154/2327] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:43 2022] DELETE /identity/v3/users/7cb4dd97242844e4a0cd038bf7ed874a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:44.173414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:44.175326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:44.190167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9229c-f33f-4204-a59b-23d2bc96a30b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:44.282047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:44.283479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:44.284265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:44.284560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] PATH_INFO: `/v3/projects/bd9ea462b48c4240ac1d02ccd561d7d2` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:44.286330 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9ea462b48c4240ac1d02ccd561d7d2)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:44.288602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:44.372674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9ea462b48c4240ac1d02ccd561d7d2', 'request_id': 'req-7f32d069-5624-46a6-9924-1e302874e1b4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.379264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9ea462b48c4240ac1d02ccd561d7d2', 'request_id': 'req-7f32d069-5624-46a6-9924-1e302874e1b4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.389656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9ea462b48c4240ac1d02ccd561d7d2', 'request_id': 'req-7f32d069-5624-46a6-9924-1e302874e1b4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.406389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] The token cache is being invalidate because project bd9ea462b48c4240ac1d02ccd561d7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:44.406389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.407111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.409388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1174/2328] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:44 2022] DELETE /identity/v3/projects/bd9ea462b48c4240ac1d02ccd561d7d2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:44.420320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:44.422967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:44.508825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615fdf9-bf0b-42d8-b253-7234c2bf1413 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:44.620836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:44.621854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:44.622594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:44.622968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] PATH_INFO: `/v3/users/dbadf9f7780f4e81b9e110c5cb277db6` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:44.624493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbadf9f7780f4e81b9e110c5cb277db6)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:44.626651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:44.704806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbadf9f7780f4e81b9e110c5cb277db6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.712407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbadf9f7780f4e81b9e110c5cb277db6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.713528 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbadf9f7780f4e81b9e110c5cb277db6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.722990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbadf9f7780f4e81b9e110c5cb277db6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.738923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c9b705dd-ba50-4bff-83f9-5699ee83e329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbadf9f7780f4e81b9e110c5cb277db6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:44.747786 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1155/2329] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:19:44 2022] DELETE /identity/v3/users/dbadf9f7780f4e81b9e110c5cb277db6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:19:45.070066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:19:45.072541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:19:45.111591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d069-5624-46a6-9924-1e302874e1b4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:19:45.173660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:19:45.175289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:19:45.175636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:19:45.175979 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] PATH_INFO: `/v3/projects/1637e14248e44635a69e7ee5de6b5519` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:19:45.177274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1637e14248e44635a69e7ee5de6b5519)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:19:45.180041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:19:45.232794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1637e14248e44635a69e7ee5de6b5519', 'request_id': 'req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:45.238564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1637e14248e44635a69e7ee5de6b5519', 'request_id': 'req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:45.246844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1637e14248e44635a69e7ee5de6b5519', 'request_id': 'req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:45.258952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] The token cache is being invalidate because project 1637e14248e44635a69e7ee5de6b5519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:19:45.259137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:45.259818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:19:45.261412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1175/2330] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:19:45 2022] DELETE /identity/v3/projects/1637e14248e44635a69e7ee5de6b5519 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:19.696527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbe41-b7a7-4665-a80e-320665299544 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:19.697059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbe41-b7a7-4665-a80e-320665299544 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:19.697059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cbe41-b7a7-4665-a80e-320665299544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:19.726100 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d43cbe41-b7a7-4665-a80e-320665299544 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:19.727321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d43cbe41-b7a7-4665-a80e-320665299544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:19.809795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1156/2331] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:19.822720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:19.824423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:19.928226 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386930e-eedd-4e3f-9e5b-0dafd43f27e2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:19.933315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:19.933964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:19.934244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:19.934541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:19.943043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:19.944644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:19.952763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1176/2332] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:20:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:20:20.461512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:20.461874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:20.462215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:20.501982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:20.503246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:20.522536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1157/2333] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:20.551426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:20.562409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a8ca1-3b02-4dc7-8306-68ba20ed5be5 service swift] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:20.567560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:20.568215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:20.568673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:20.568950 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:20.579420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:20.580695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:20.590981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1177/2334] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:20:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:20:25.149561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:25.152439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:25.249150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:25.250611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:25.385298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eff5c-25ff-4a62-b691-821a4816c2bf None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:25.390143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:25.391082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.391510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.391790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] PATH_INFO: `/v3/users/3f1cedefc7254a4797b7d6ca461a065c` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.393232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1cedefc7254a4797b7d6ca461a065c)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:25.395297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:25.395495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d69e-3829-44a5-82ce-942e27470d23 service swift] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:25.400798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:25.401949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.402569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.403001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] PATH_INFO: `/v3/users/d8147af6ecd44d5aba4f31f27c3a8743` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.404497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8147af6ecd44d5aba4f31f27c3a8743)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:25.407138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:25.455386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1cedefc7254a4797b7d6ca461a065c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.464016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1cedefc7254a4797b7d6ca461a065c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.465040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1cedefc7254a4797b7d6ca461a065c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.477085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1cedefc7254a4797b7d6ca461a065c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.492827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c0f9b812-6bc6-4a1c-941f-dfce66bbc73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1cedefc7254a4797b7d6ca461a065c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.494017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8147af6ecd44d5aba4f31f27c3a8743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.504749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1158/2335] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:20:25 2022] DELETE /identity/v3/users/3f1cedefc7254a4797b7d6ca461a065c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:25.507716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8147af6ecd44d5aba4f31f27c3a8743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.508589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8147af6ecd44d5aba4f31f27c3a8743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.509352 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8147af6ecd44d5aba4f31f27c3a8743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.545376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8147af6ecd44d5aba4f31f27c3a8743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.571858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1178/2336] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:20:25 2022] DELETE /identity/v3/users/d8147af6ecd44d5aba4f31f27c3a8743 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:25.574808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.575344 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.576148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.611842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:25.613495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:25.699822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1159/2337] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:25.710592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:25.712511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:25.765580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:25.767026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:25.781988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9554b-5294-416f-b5e1-b90536d854e6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:25.791735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:25.796540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.797238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.797862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] PATH_INFO: `/v3/projects/c22207151467401697a2e27ce66fbc1f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.799267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22207151467401697a2e27ce66fbc1f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:25.801195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:25.866905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc79a-9d8d-4a6f-8708-280841d1f94a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:25.886487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22207151467401697a2e27ce66fbc1f', 'request_id': 'req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.894449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22207151467401697a2e27ce66fbc1f', 'request_id': 'req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.902006 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22207151467401697a2e27ce66fbc1f', 'request_id': 'req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.938354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] The token cache is being invalidate because project c22207151467401697a2e27ce66fbc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:20:25.938354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.938354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b017c6df-b78c-4c2c-8578-2cd6fb9a699d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:25.938354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1160/2338] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:20:25 2022] DELETE /identity/v3/projects/c22207151467401697a2e27ce66fbc1f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:20:25.938354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e604-557d-4797-aa53-029019b38602 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.939203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e604-557d-4797-aa53-029019b38602 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.939203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e604-557d-4797-aa53-029019b38602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.985173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:25.985850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:25.986126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:25.986450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:25.988389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.005107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3941e604-557d-4797-aa53-029019b38602 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:26.006464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3941e604-557d-4797-aa53-029019b38602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.079164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.081142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.089542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1161/2339] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:26.091714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1179/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:26.098305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.098598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.099359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.120008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:26.121410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.133581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1162/2341] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:26.138157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.156632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98bbd4-d3fb-4af7-9a94-788a101602c4 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.167076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.167895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.168280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.168649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.169612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:20:26.170042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.171839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.187928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1180/2342] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:20:26.194137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.205610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0d1ec-1447-4d3c-968a-decafb355fae None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.211074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.211744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.212028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.212303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.213000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.214973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.262268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1163/2343] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:20:26.267511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.281295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac514-e73e-482f-bed8-ea113575a0cd admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.356565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.357704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.358163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.358632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.359507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.361710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.412516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1181/2344] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:20:26.416888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.430315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364560b-d050-430d-8662-f1adfff114a1 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.440493 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.441332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.441789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.444255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.445578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.455634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.478154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1164/2345] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:20:26.483675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.498927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4b4d4-7faf-41de-af3a-2bc8f08b83e6 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.505725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.506658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.506945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.507219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.507958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.509569 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.514014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.515805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.545064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c4752-4fe7-4b9b-8297-fce5e0228a4e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.548814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1182/2346] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:26.553495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.562186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.563137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.563416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.563692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] PATH_INFO: `/v3/projects/69ca58f4d1524f4e99d0966289330ea7` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.564937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ca58f4d1524f4e99d0966289330ea7)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.566963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.574686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869472-c706-4d0c-87b2-4b34d0d6c25a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.580265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.581201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.581486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.581783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] PATH_INFO: `/v3/projects/0a2eaa964e8b4ce3827b730eaccc80a0/users/fb205901ad6b406aa3b7ae6b27152e44/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.602557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2eaa964e8b4ce3827b730eaccc80a0, user_id=fb205901ad6b406aa3b7ae6b27152e44, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.607353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68879019-b922-4f1b-b4a9-a825d589dd67 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.640085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1183/2347] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:26 2022] PUT /identity/v3/projects/0a2eaa964e8b4ce3827b730eaccc80a0/users/fb205901ad6b406aa3b7ae6b27152e44/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:26.650633 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.651137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.651731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.676240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ca58f4d1524f4e99d0966289330ea7', 'request_id': 'req-f6260b42-af37-4f89-8a49-5666190118ab'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:26.686809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ca58f4d1524f4e99d0966289330ea7', 'request_id': 'req-f6260b42-af37-4f89-8a49-5666190118ab'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:26.700039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ca58f4d1524f4e99d0966289330ea7', 'request_id': 'req-f6260b42-af37-4f89-8a49-5666190118ab'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:26.705728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] MFA Rules not processed for user `fb205901ad6b406aa3b7ae6b27152e44`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:26.707492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.733287 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] The token cache is being invalidate because project 69ca58f4d1524f4e99d0966289330ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:20:26.734178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:26.735459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f6260b42-af37-4f89-8a49-5666190118ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:26.738541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1165/2348] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:20:26 2022] DELETE /identity/v3/projects/69ca58f4d1524f4e99d0966289330ea7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:26.743785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790ecd-0ddb-4bda-a53a-1dab91edaff0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.744072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790ecd-0ddb-4bda-a53a-1dab91edaff0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.744349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790ecd-0ddb-4bda-a53a-1dab91edaff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.795915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-db790ecd-0ddb-4bda-a53a-1dab91edaff0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:26.797469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-db790ecd-0ddb-4bda-a53a-1dab91edaff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.824231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1184/2349] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:26.837141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.838914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.902038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1166/2350] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:26.909859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61126bf2-498e-4707-b487-3262b54914bf None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.910236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61126bf2-498e-4707-b487-3262b54914bf None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.910632 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61126bf2-498e-4707-b487-3262b54914bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.922504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f6b7-306e-474a-91ec-89c1f7fdf36e None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.927807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.939307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-61126bf2-498e-4707-b487-3262b54914bf None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:26.939307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-61126bf2-498e-4707-b487-3262b54914bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:26.939473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.939473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.939473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.949094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.950363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1167/2351] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:26.951085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.951374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61126bf2-498e-4707-b487-3262b54914bf None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:26.961010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1185/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:20:26.961389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61126bf2-498e-4707-b487-3262b54914bf None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:26.968011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:26.969276 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:26.969730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:26.970503 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:26.971612 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:20:26.972261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:26.974223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:26.991787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1168/2353] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:20:27.006071 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.031382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3f89-634a-4a40-bc0a-e16beef67feb service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.036599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.037351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.037631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.038011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.038845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.040871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.102832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1186/2354] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:26 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:27.104562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.120213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98275-cbc8-4124-b7f0-e1e083a7b41d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.238988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.239641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.239927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.240197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.240888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.242989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.282769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.283427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1169/2355] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:27 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:27.293334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9163469-2e45-4310-9bc8-5e3a418d9fd2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.299107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.299781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.300054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.300506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.301396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.303305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.324433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.329884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1187/2356] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:27.340444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514037-e8d7-44f4-8dfb-9a9f5c9aaa7d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.347874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.348736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.349179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.349317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.349962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.351894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014071bc-89c6-4120-b347-c61c5ab263aa admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.371064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1170/2357] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:27.372829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.389235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbecdd-4554-451f-aca1-0e6aaf7f2bc5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.406196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.407313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.407972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.409988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] PATH_INFO: `/v3/projects/79fa2d317b3148b58ab132c5642a37e0/users/7fbbf75beed547b68ce1ee9f6d86f8d5/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.446455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fa2d317b3148b58ab132c5642a37e0, user_id=7fbbf75beed547b68ce1ee9f6d86f8d5, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.449295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.464208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1188/2358] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:27 2022] PUT /identity/v3/projects/79fa2d317b3148b58ab132c5642a37e0/users/7fbbf75beed547b68ce1ee9f6d86f8d5/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:27.480895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.481549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.482249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.551319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] MFA Rules not processed for user `7fbbf75beed547b68ce1ee9f6d86f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:27.552898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:27.641623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1171/2359] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:27.653857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:27.655608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:27.730475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1b7d-6c61-4eb6-b8d8-461b9a4c15f9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:27.735922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:27.736674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:27.736999 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:27.737294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:27.757069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:27.758655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d525-cb92-4e63-9165-f370f79a3780 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:27.771365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1189/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:42.596600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:42.598229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:42.665297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2cc65-a1d3-4a11-9598-69a255a50866 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:42.670140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:42.671291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:42.671597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:42.671904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] PATH_INFO: `/v3/users/fb205901ad6b406aa3b7ae6b27152e44` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:42.673187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb205901ad6b406aa3b7ae6b27152e44)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:42.675364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:42.721467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb205901ad6b406aa3b7ae6b27152e44'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:42.728346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb205901ad6b406aa3b7ae6b27152e44'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:42.729044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb205901ad6b406aa3b7ae6b27152e44'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:42.738072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb205901ad6b406aa3b7ae6b27152e44'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:42.751424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb205901ad6b406aa3b7ae6b27152e44'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:42.757796 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1172/2361] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:20:42 2022] DELETE /identity/v3/users/fb205901ad6b406aa3b7ae6b27152e44 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:42.762462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea94268-7137-43dc-9a7d-32373269537e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:42.762980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea94268-7137-43dc-9a7d-32373269537e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:42.763076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea94268-7137-43dc-9a7d-32373269537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:42.780819 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-eea94268-7137-43dc-9a7d-32373269537e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:42.782166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-eea94268-7137-43dc-9a7d-32373269537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:42.848768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1190/2362] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:42.862347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:42.862347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:42.924417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb444-6465-48c7-a685-7a6230d63237 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:42.928142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:42.928799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:42.929070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:42.929340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:42.939391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:42.940909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d224599-2dcc-4772-ae42-984feb001dd2 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:42.954325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1173/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:43.043367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.043977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.044603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] PATH_INFO: `/` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.046787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1191/2364] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:20:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:20:43.053292 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.053582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.053898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.128529 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.129760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.234712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1174/2365] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:43.246615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.248670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.295312 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.296892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.311142 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfcb0a-7ca7-4c9c-b752-abda85193f34 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.311320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c8d6-acc5-4220-ad0a-2d084baeebee None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.319107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.319943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.320328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.320761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.322832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.324143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.324424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.324696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] PATH_INFO: `/v3/projects/0a2eaa964e8b4ce3827b730eaccc80a0` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.325970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2eaa964e8b4ce3827b730eaccc80a0)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.328175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.337214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.338739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09b04e-8482-48d0-a4af-a41210d21520 service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.350404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1192/2366] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:43.386443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2eaa964e8b4ce3827b730eaccc80a0', 'request_id': 'req-a059aa3b-18de-4988-a884-599a3c28d610'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:43.392559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2eaa964e8b4ce3827b730eaccc80a0', 'request_id': 'req-a059aa3b-18de-4988-a884-599a3c28d610'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:43.397966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2eaa964e8b4ce3827b730eaccc80a0', 'request_id': 'req-a059aa3b-18de-4988-a884-599a3c28d610'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:43.410590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] The token cache is being invalidate because project 0a2eaa964e8b4ce3827b730eaccc80a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:20:43.410873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:43.411508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a059aa3b-18de-4988-a884-599a3c28d610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:43.413236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1175/2367] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:20:43 2022] DELETE /identity/v3/projects/0a2eaa964e8b4ce3827b730eaccc80a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:20:43.418686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2ca17-fa0d-4374-a87e-b84ae7b4e03c None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.419004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2ca17-fa0d-4374-a87e-b84ae7b4e03c None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.419279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2ca17-fa0d-4374-a87e-b84ae7b4e03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.421144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3e55-ac59-43f4-a390-9e5da220bac6 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.421453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3e55-ac59-43f4-a390-9e5da220bac6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.421723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3e55-ac59-43f4-a390-9e5da220bac6 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.423658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1176/2368] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:20:43.428906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.429241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.429523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.437419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e6e2ca17-fa0d-4374-a87e-b84ae7b4e03c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.438635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e6e2ca17-fa0d-4374-a87e-b84ae7b4e03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.447377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] MFA Rules not processed for user `cff2fae13e4b40b5b61775a27747fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.448548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.494475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1193/2369] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:43.499143 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1177/2370] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:43.502443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.502730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.503005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.510873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.512308 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.520736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.521898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.522478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921432-d949-42e9-8cc6-7d46d6428988 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.526216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.526886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.527167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.527441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.529830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1194/2371] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:43.534117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.534832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.536270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.543245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d09d41-351c-4852-b9b0-2902627d0126 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.544170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1178/2372] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:43.548112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.548759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.549039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.549310 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.550032 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:20:43.550367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.551959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.563702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1195/2373] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:20:43.568109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.579229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f6e92-9ec4-40f6-b8d9-81c6c20ec99c service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.584066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.584838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.585188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.585465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.586202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.588235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361906eb-4672-4b36-bacd-69bc29584b7d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.614690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1179/2374] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:43.618756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.629409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1def3-468b-4131-830b-b8b2b83fe966 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.634874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428cdec-c1e0-4da6-8a59-3d8508860c98 None None] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.635165 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428cdec-c1e0-4da6-8a59-3d8508860c98 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.635439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428cdec-c1e0-4da6-8a59-3d8508860c98 None None] PATH_INFO: `/` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.637187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1180/2375] 10.222.0.18 () {54 vars in 921 bytes} [Sun Mar 20 16:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 20 16:20:43.642395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.642681 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.642956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.660954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] MFA Rules not processed for user `8c61a24263474ff7926d416bedf11db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.662158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.684890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.685471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.685750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.686022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.686738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.688701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.708423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1196/2376] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:43.712402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.721884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24440f0-5768-4009-91b1-39b27f61ef5b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.726504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.727152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.727430 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.727708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.727828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1181/2377] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:20:43.728500 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.730225 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.737996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.743078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1197/2378] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:20:43.744096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.753805 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604bc2b-6671-42f9-82d9-a9ec0538d358 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.758778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.759414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.759695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.759963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.760677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.762270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.773041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1198/2379] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:43.777050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.786645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d6eb4-3e0d-4816-94e8-005e011d5760 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.791559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.792435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.792710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.792886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad89a-e3ac-46ab-9b9b-c42cab4dd72d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.793026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] PATH_INFO: `/v3/projects/b99ce29c08104e2788002fbd04410b3a/users/273d848f2fb24c3eb807d5f6bc2a18fa/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.796712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.797350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.797628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.797897 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.807881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99ce29c08104e2788002fbd04410b3a, user_id=273d848f2fb24c3eb807d5f6bc2a18fa, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.808042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.809365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02d2fb-1e7d-4c1f-8ca6-9f86cd772a44 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.810743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:43.820605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1182/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:43.825398 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1199/2381] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:43 2022] PUT /identity/v3/projects/b99ce29c08104e2788002fbd04410b3a/users/273d848f2fb24c3eb807d5f6bc2a18fa/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:20:43.830438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.830864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.831232 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.848354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:43.849541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:43.907522 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1183/2382] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:43.917384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:43.977736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbd9c-e60a-4299-8a61-7a348c2bf503 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:43.981603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:43.982421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:43.982763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:43.983097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:43.992852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:43.994395 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a214b-3adb-4794-9cef-0d9bbd9c8d6c service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:44.005951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1200/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:47.236268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:47.237731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:47.268108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3a10-51b7-48e2-a0f8-a9dddcdc5015 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:47.282205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:47.283407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:47.283837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:47.284270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] PATH_INFO: `/v3/users/2c87fb221dac452cba7a34a24cc045d3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:47.287158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c87fb221dac452cba7a34a24cc045d3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:47.300018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:47.431607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c87fb221dac452cba7a34a24cc045d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:47.438785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c87fb221dac452cba7a34a24cc045d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:47.439511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c87fb221dac452cba7a34a24cc045d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:47.460729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c87fb221dac452cba7a34a24cc045d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:47.489410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c87fb221dac452cba7a34a24cc045d3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:47.497387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1184/2384] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:20:47 2022] DELETE /identity/v3/users/2c87fb221dac452cba7a34a24cc045d3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:47.502572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:47.503059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:47.503180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:47.528809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:47.530746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:47.613691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1201/2385] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:47.623729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:47.625415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:47.695168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2dc8-4ed2-48ab-b835-51572b03827a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:47.701067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:47.701740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:47.702024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:47.702848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:47.714836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:47.717402 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccb628-0ec3-4907-8e32-49c99777c0ad service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:47.732224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1185/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:48.575977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:48.577422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:48.593164 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3d104-4dcb-4d7d-b009-efcb2e252194 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:48.609210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:48.612122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:48.612839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:48.615288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] PATH_INFO: `/v3/projects/b13047c9554a42dba3b68d84f19ecf10` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:48.620055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13047c9554a42dba3b68d84f19ecf10)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:48.622229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:48.714581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13047c9554a42dba3b68d84f19ecf10', 'request_id': 'req-20a26c65-b38e-43de-987d-c35c45c146a4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:48.747635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13047c9554a42dba3b68d84f19ecf10', 'request_id': 'req-20a26c65-b38e-43de-987d-c35c45c146a4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:48.768756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13047c9554a42dba3b68d84f19ecf10', 'request_id': 'req-20a26c65-b38e-43de-987d-c35c45c146a4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:48.787662 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] The token cache is being invalidate because project b13047c9554a42dba3b68d84f19ecf10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:20:48.787996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:48.790341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-20a26c65-b38e-43de-987d-c35c45c146a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:48.796058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1202/2387] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:20:48 2022] DELETE /identity/v3/projects/b13047c9554a42dba3b68d84f19ecf10 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:48.801692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:48.802227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:48.802227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:48.866515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:48.867765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:48.985608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1186/2388] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:48.994698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:48.994988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:48.995546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.023880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:49.025104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:49.033795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1203/2389] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:49.037973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.051235 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470509-8e5c-4aaa-a357-dac5597f498c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.061243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.062467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.062936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.063704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.064759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:20:49.065391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.067319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.090747 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1187/2390] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:20:49.092716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.109488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d297969-0d77-42a6-8280-7bedcc84b0c8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.120094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.121112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.121684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.122213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.123457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.127641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.194822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.195094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1204/2391] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:49 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:49.225297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9afb-0430-4242-bcd4-63a31ff0bda5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.355223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.355919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.357386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.357386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.357386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.361770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.400837 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1188/2392] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:49 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:20:49.402081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.417316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c370e-ab03-4bf4-bb76-697a7d1e6326 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.422145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.422876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.423162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.423437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.424180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.425806 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.448221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1205/2393] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:49.449678 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.466804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fc58-e0f4-4797-a938-03cceefce7c4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.477889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.479027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.479827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.480516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.482457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.486638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae307-2043-47c1-935f-b082894b67f4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.502848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1189/2394] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:49.508122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.518565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069b6f8-5c41-4ce4-8edf-e9d65b2ddf29 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.529088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.530152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.530477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.530759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] PATH_INFO: `/v3/projects/17cc716774984a15b9d00eb21651b3ee/users/6b8e5fa032c5450bab0b54a7be0c046c/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.555097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17cc716774984a15b9d00eb21651b3ee, user_id=6b8e5fa032c5450bab0b54a7be0c046c, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.560175 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.606889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1206/2395] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:49 2022] PUT /identity/v3/projects/17cc716774984a15b9d00eb21651b3ee/users/6b8e5fa032c5450bab0b54a7be0c046c/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:49.612127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b451-a52d-4b87-bc93-0a85b0184879 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.612478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b451-a52d-4b87-bc93-0a85b0184879 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.612724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b451-a52d-4b87-bc93-0a85b0184879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.641946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d243b451-a52d-4b87-bc93-0a85b0184879 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:49.643279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d243b451-a52d-4b87-bc93-0a85b0184879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:49.730847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1190/2396] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:49.758573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:49.760363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:49.853439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48424292-43b3-4a44-a8a5-c612e6272424 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:49.858086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:49.858660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:49.859189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:49.859650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:49.871153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:49.873347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:49.887577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1207/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:50.590034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa55-62fb-4bcb-a65c-c11e8cd9e317 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:50.590679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa55-62fb-4bcb-a65c-c11e8cd9e317 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:50.590679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa55-62fb-4bcb-a65c-c11e8cd9e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:50.614481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e81afa55-62fb-4bcb-a65c-c11e8cd9e317 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:50.615989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e81afa55-62fb-4bcb-a65c-c11e8cd9e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:50.748513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1191/2398] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:50.790174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:50.792374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:51.053684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc113e5-1274-4e6c-b6f4-fc316ef553e1 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:51.060759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:51.062199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.062748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.063615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:51.075873 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:51.078166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:51.103112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1208/2399] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:20:51.328795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.329337 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.329761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:51.388530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] MFA Rules not processed for user `273d848f2fb24c3eb807d5f6bc2a18fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:51.390188 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:51.528451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1192/2400] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:51.533167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:51.534773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:51.573104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ad7f-2ebe-4977-84b2-1462cd17d71e service swift] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:51.587697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:51.588766 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.589266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.589807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:51.590792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:51.596130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:51.647771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:51.654589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1209/2401] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:51 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:51.663435 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50646-8d19-4145-b0db-127a53dbc26d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:51.795166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:51.796166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.798090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.798549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:51.799417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:51.808856 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:51.853691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:51.854725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1193/2402] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:51 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:51.869497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65425c0-7b3d-41e1-9d86-2e4d5928d5e8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:51.880671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:51.881687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.882146 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.882624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:51.883529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:51.885376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:51.940336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1210/2403] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:51.945034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:51.960456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa60e1-d71e-44b3-924f-5de00b143062 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:51.981161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:51.982531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:51.983022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:51.983500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] PATH_INFO: `/v3/projects/9cac0be36d3e4669b05b5b1f30802658/users/b060ec7498004262b2b59dceff6141a0/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:52.028300 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cac0be36d3e4669b05b5b1f30802658, user_id=b060ec7498004262b2b59dceff6141a0, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:52.031169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:52.081459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:52.082160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1194/2404] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:51 2022] PUT /identity/v3/projects/9cac0be36d3e4669b05b5b1f30802658/users/b060ec7498004262b2b59dceff6141a0/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:52.094681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248d33-2756-4038-8698-cf09e64c94bf admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:52.155125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:52.161735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:52.255423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:52.256216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:52.256708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:52.257160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:52.258274 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:52.260112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:52.329581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1211/2405] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:52.331431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:52.376632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701bc23-40b9-4dc5-abbf-7e7084fbc613 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:52.404442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:52.405357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:52.405636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:52.405908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] PATH_INFO: `/v3/projects/9cac0be36d3e4669b05b5b1f30802658/users/b060ec7498004262b2b59dceff6141a0/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:52.410816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cac0be36d3e4669b05b5b1f30802658, user_id=b060ec7498004262b2b59dceff6141a0, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:52.413551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823546-5caf-482a-9c31-cb967061ea64 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:52.432080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1212/2406] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:52 2022] PUT /identity/v3/projects/9cac0be36d3e4669b05b5b1f30802658/users/b060ec7498004262b2b59dceff6141a0/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:52.450269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540720b-1afe-449a-bfcf-c9b3fc569b56 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:52.712568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:52.715608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:52.715993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:52.716307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] PATH_INFO: `/v3/users/7fbbf75beed547b68ce1ee9f6d86f8d5` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:52.723040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbbf75beed547b68ce1ee9f6d86f8d5)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:52.727371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:52.870384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbbf75beed547b68ce1ee9f6d86f8d5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:52.891434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbbf75beed547b68ce1ee9f6d86f8d5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:52.892432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbbf75beed547b68ce1ee9f6d86f8d5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:52.922062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbbf75beed547b68ce1ee9f6d86f8d5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:52.955641 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbbf75beed547b68ce1ee9f6d86f8d5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:52.972379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1195/2407] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:20:52 2022] DELETE /identity/v3/users/7fbbf75beed547b68ce1ee9f6d86f8d5 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:20:52.977115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:52.977987 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:52.978471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:53.016973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:53.022066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:53.172138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1213/2408] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:53.198621 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:53.200268 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:53.317211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4d5e-17ee-4d22-b9e7-678513771d2d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:53.322144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:53.323071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:53.323415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:53.323750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:53.357248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:53.359457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e572-47b3-4c0d-b5b3-85206663d11e service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:53.374070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1196/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:20:54.120924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:54.134905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:54.144524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e0601-a068-4c71-b714-fbc8f34e978a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:54.151036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:54.152020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:54.152410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:54.153366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] PATH_INFO: `/v3/projects/79fa2d317b3148b58ab132c5642a37e0` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:54.154962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fa2d317b3148b58ab132c5642a37e0)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:54.157578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:54.315511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fa2d317b3148b58ab132c5642a37e0', 'request_id': 'req-967444fa-2143-4255-bb7d-28ad6036b0a9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:54.336013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fa2d317b3148b58ab132c5642a37e0', 'request_id': 'req-967444fa-2143-4255-bb7d-28ad6036b0a9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:54.350580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fa2d317b3148b58ab132c5642a37e0', 'request_id': 'req-967444fa-2143-4255-bb7d-28ad6036b0a9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:54.376428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] The token cache is being invalidate because project 79fa2d317b3148b58ab132c5642a37e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:20:54.376726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:54.381877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:20:54.387683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1214/2410] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:20:54 2022] DELETE /identity/v3/projects/79fa2d317b3148b58ab132c5642a37e0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:57.893804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:57.894433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:57.894535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:57.961162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] MFA Rules not processed for user `6b8e5fa032c5450bab0b54a7be0c046c`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:20:57.970416 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:58.249548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1197/2411] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:20:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:20:58.250629 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:58.252141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:20:58.510215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967444fa-2143-4255-bb7d-28ad6036b0a9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:58.522790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:58.523504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:58.525000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:58.526582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:58.527883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:58.532707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:58.628635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1215/2412] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:20:58 2022] POST /identity/v3/projects => generated 369 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:20:58.628851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:58.675036 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab026-0e94-408a-83d3-f21f7705f8da None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:58.849572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:58.850434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:58.850609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:58.850855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:58.851526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:58.855615 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:58.908288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1198/2413] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:20:58 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:20:58.912756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:58.938860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84384d7-9e8c-40d0-84ef-0c60380a6ee4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:58.953140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:58.957332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:58.958861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:58.961656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:58.967947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:58.978765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:59.011559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1216/2414] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:59.014925 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:59.032788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1ac11-028a-426c-9511-813a0b24805c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:59.056338 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:59.057642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:59.058107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:59.061081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] PATH_INFO: `/v3/projects/35b67da8df2646d082a9de338e7c1ddd/users/829b23b18ee849078534374e07f6e1d1/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:59.135948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b67da8df2646d082a9de338e7c1ddd, user_id=829b23b18ee849078534374e07f6e1d1, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:59.138949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:59.166726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1199/2415] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:59 2022] PUT /identity/v3/projects/35b67da8df2646d082a9de338e7c1ddd/users/829b23b18ee849078534374e07f6e1d1/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:20:59.170815 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:59.189519 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3901ed-753b-4720-86d0-6acccb9ca337 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:59.376407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:59.377131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:59.377389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:59.377660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:59.378427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:59.380067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84aa1d1-e3d0-4088-aa08-8d4e0cf7ceb1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:59.411357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1217/2416] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:20:59.412366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:20:59.437543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceebae0-667e-4d42-80d6-84066189ab58 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:20:59.446219 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:20:59.447545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:20:59.449665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:20:59.450576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] PATH_INFO: `/v3/projects/35b67da8df2646d082a9de338e7c1ddd/users/829b23b18ee849078534374e07f6e1d1/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:20:59.458020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b67da8df2646d082a9de338e7c1ddd, user_id=829b23b18ee849078534374e07f6e1d1, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:20:59.469226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1360-1bac-4a9b-9b2f-207dd78b385f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:20:59.510862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1200/2417] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:20:59 2022] PUT /identity/v3/projects/35b67da8df2646d082a9de338e7c1ddd/users/829b23b18ee849078534374e07f6e1d1/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:21:01.148438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:01.149030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:01.149126 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:01.188456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] MFA Rules not processed for user `5410f46266e048f399e60fd3f2d565d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:01.191752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:01.351678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1218/2418] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:03.074047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351366-117c-48b5-9c90-d337745fda20 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:03.074610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351366-117c-48b5-9c90-d337745fda20 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:03.074910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351366-117c-48b5-9c90-d337745fda20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:03.140139 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0f351366-117c-48b5-9c90-d337745fda20 None None] MFA Rules not processed for user `b060ec7498004262b2b59dceff6141a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:03.143391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0f351366-117c-48b5-9c90-d337745fda20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:03.420819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1201/2419] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:03.429630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:03.431416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:03.534977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9f1ae-aa80-48a0-a675-af8f16071032 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:03.549396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:03.550406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:03.550854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:03.551848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:03.556026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:03.704790 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:03.706194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:03.743331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1219/2420] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:04.047477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:04.048121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:04.048557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:04.130004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:04.133864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:04.449952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1202/2421] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:04.465213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:04.467685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:04.727256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88408b28-77e7-42ed-92ea-477cc2596821 service glance] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:04.744983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:04.754602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:04.754602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:04.754602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:04.768677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:04.771525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc797303-c03e-4a7c-ae94-9ec1732d997b service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:04.789861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1220/2422] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:21:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:21:04.806410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:04.808161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:05.121802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedef80-3e7c-4622-b101-92f30a40b3a3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:05.128855 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:05.129842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:05.130394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:05.131389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:05.133727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:05.147077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:05.149305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:05.162041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1203/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:14.327067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db2df1-dc05-4652-85a0-4d15d7d772fe None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:14.327695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db2df1-dc05-4652-85a0-4d15d7d772fe None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:14.327695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db2df1-dc05-4652-85a0-4d15d7d772fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:14.415874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a5db2df1-dc05-4652-85a0-4d15d7d772fe None None] MFA Rules not processed for user `829b23b18ee849078534374e07f6e1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:14.419079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a5db2df1-dc05-4652-85a0-4d15d7d772fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:14.651977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1221/2424] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:14.658225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:14.661969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:14.820487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f034db-10e2-4028-9ba0-fe565402d8f8 service placement] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:14.837237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:14.838137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:14.839237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:14.839778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:14.908822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:14.910462 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4669adb-ba82-4c3b-8b39-20b05e86e47d service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:14.925724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1204/2425] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:18.072561 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f471-b5c6-4b56-8638-8509d15e91b2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:18.073540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f471-b5c6-4b56-8638-8509d15e91b2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:18.073961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f471-b5c6-4b56-8638-8509d15e91b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:18.120578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6291f471-b5c6-4b56-8638-8509d15e91b2 None None] MFA Rules not processed for user `6b8e5fa032c5450bab0b54a7be0c046c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:18.122060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6291f471-b5c6-4b56-8638-8509d15e91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:18.142017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1222/2426] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:23.004302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:23.005298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:23.005609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:23.025275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] MFA Rules not processed for user `273d848f2fb24c3eb807d5f6bc2a18fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:23.027900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:23.036399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1205/2427] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:23.653728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6993-e247-4ed9-be93-fe6193084e59 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:23.654783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6993-e247-4ed9-be93-fe6193084e59 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:23.655930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6993-e247-4ed9-be93-fe6193084e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:23.721445 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a9bb6993-e247-4ed9-be93-fe6193084e59 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:23.724448 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a9bb6993-e247-4ed9-be93-fe6193084e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:23.754985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1223/2428] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:23.759487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:23.793719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b63e45-f10b-438e-95f5-7155ac7ca99b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:23.802718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:23.803605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:23.803937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:23.804388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:23.818810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:23.821423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:23.837376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1206/2429] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:21:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:21:25.702081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:25.702634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:25.702634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:25.721224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:25.723380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:25.731828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1224/2430] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:25.744835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:25.755919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fee96-2526-44e2-8dac-42c1fc51ce5a service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:25.761525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:25.762566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:25.762715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:25.763723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:25.775264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:25.777001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:25.801461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1207/2431] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:21:28.251177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:28.252769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:28.364228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1c14-4c61-4dd7-9438-b3995852a948 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:28.370235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:28.371588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:28.372192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:28.372608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] PATH_INFO: `/v3/users/eb902201a42144e190a4237f4e568adf` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:28.374362 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb902201a42144e190a4237f4e568adf)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:28.376663 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:28.513910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb902201a42144e190a4237f4e568adf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:28.524089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb902201a42144e190a4237f4e568adf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:28.525118 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb902201a42144e190a4237f4e568adf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:28.526168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb902201a42144e190a4237f4e568adf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:28.540582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2dcee581-e6f3-4777-924c-8d7e65fa3ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb902201a42144e190a4237f4e568adf'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:28.553794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1225/2432] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:21:28 2022] DELETE /identity/v3/users/eb902201a42144e190a4237f4e568adf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:28.992017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.010330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a21b1-d45b-4910-b87c-665bf311a781 service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.186360 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.187560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.188030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.188464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] PATH_INFO: `/v3/projects/6d36d10d56cc45bcb8f737c8245935ac` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.191883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d36d10d56cc45bcb8f737c8245935ac)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.194001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.307698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d36d10d56cc45bcb8f737c8245935ac', 'request_id': 'req-75b43367-701f-4847-a21c-ca09d9ffe96e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:29.344315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d36d10d56cc45bcb8f737c8245935ac', 'request_id': 'req-75b43367-701f-4847-a21c-ca09d9ffe96e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:29.352578 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d36d10d56cc45bcb8f737c8245935ac', 'request_id': 'req-75b43367-701f-4847-a21c-ca09d9ffe96e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:29.375295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] The token cache is being invalidate because project 6d36d10d56cc45bcb8f737c8245935ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:21:29.376072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:29.376942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-75b43367-701f-4847-a21c-ca09d9ffe96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:29.380060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1208/2433] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:21:28 2022] DELETE /identity/v3/projects/6d36d10d56cc45bcb8f737c8245935ac => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:29.384970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.385924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.386436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.410959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:29.412588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:29.483038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1226/2434] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:29.493639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.493934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.494213 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.520297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:29.521449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:29.530956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1209/2435] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:29.535410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.545835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faec0b-f96c-4731-9dfd-fe7ec7b55b98 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.553807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.554971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.555421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.555696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.556440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:21:29.556917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.558772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.571267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1227/2436] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:21:29.575873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.586065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7c8b2-0e8b-41db-9a2e-1832de212f34 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.591606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.592357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.592639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.592921 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.593635 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.595610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.630392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1210/2437] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:21:29 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:21:29.634717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.645107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c92a-e1dc-47b7-8684-b4d4ca42b283 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.713556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.714248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.714557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.714829 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.715634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.717572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.746347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1228/2438] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:21:29 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:29.751255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.761997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500293dd-a9b3-4765-832e-0284df550c4e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.766946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.767725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.768053 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.768328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.769217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.770950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.782593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1211/2439] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:29.787038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.801471 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ee4c-94b3-49ca-a2d3-afa023a64def admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.807065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.807970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.808247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.808522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.809541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.811207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037817f2-4d53-4b80-be3d-e3f08d7838c8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.821984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1229/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:29.826595 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:29.836938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8fc25-7eb8-458f-b697-db9066068778 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:29.841536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:29.842472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.842760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.843026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] PATH_INFO: `/v3/projects/710d4deaba2b45fdb21c6febad57ce13/users/848384523cec4a04934748a464b575ea/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.858653 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=710d4deaba2b45fdb21c6febad57ce13, user_id=848384523cec4a04934748a464b575ea, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:29.861724 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:29.877380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1212/2441] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:21:29 2022] PUT /identity/v3/projects/710d4deaba2b45fdb21c6febad57ce13/users/848384523cec4a04934748a464b575ea/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:29.887507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:29.887793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:29.888077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:29.920636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] MFA Rules not processed for user `848384523cec4a04934748a464b575ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:29.922132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:30.000679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1230/2442] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:30.012944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:30.015032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:30.103470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be204d92-105b-4bbb-8c76-f72f6e281a3e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:30.117955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:30.118674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:30.118954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:30.119234 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:30.136731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:30.138517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacf356-3e2d-4878-b1a4-9a28e846688d service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:30.148722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1213/2443] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:39.824275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:39.904306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4849-c764-44ec-9878-fca7cae59dac None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:39.909111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:39.910490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:39.910958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:39.911367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] PATH_INFO: `/v3/users/848384523cec4a04934748a464b575ea` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:39.914036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848384523cec4a04934748a464b575ea)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:39.917548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:39.979504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848384523cec4a04934748a464b575ea'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:39.989376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848384523cec4a04934748a464b575ea'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:39.989932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848384523cec4a04934748a464b575ea'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:39.990627 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848384523cec4a04934748a464b575ea'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.004304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848384523cec4a04934748a464b575ea'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.017068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1231/2444] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:21:39 2022] DELETE /identity/v3/users/848384523cec4a04934748a464b575ea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:40.021535 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.022059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.022059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.039444 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:40.040648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:40.111819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1214/2445] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:21:40.121234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:40.123700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:40.178364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44ae2-39f6-42fe-be78-d9d2f135fd58 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:40.181918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:40.182642 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.182918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.183186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.192067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:40.193524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56436537-5a78-43cf-9f28-7ba4b1af2e81 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:40.203871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1232/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:40.601996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:40.604413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:40.617379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ccf5-baaa-475f-9f16-7c5fda99613f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:40.623636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:40.624644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.625027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.625482 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] PATH_INFO: `/v3/projects/710d4deaba2b45fdb21c6febad57ce13` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.627022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=710d4deaba2b45fdb21c6febad57ce13)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:40.629048 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:40.684875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710d4deaba2b45fdb21c6febad57ce13', 'request_id': 'req-2752be55-99a2-4951-acaa-f2766239b69e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.691779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710d4deaba2b45fdb21c6febad57ce13', 'request_id': 'req-2752be55-99a2-4951-acaa-f2766239b69e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.697834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710d4deaba2b45fdb21c6febad57ce13', 'request_id': 'req-2752be55-99a2-4951-acaa-f2766239b69e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.710844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] The token cache is being invalidate because project 710d4deaba2b45fdb21c6febad57ce13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:21:40.711137 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.711748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2752be55-99a2-4951-acaa-f2766239b69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:40.713323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1215/2447] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:21:40 2022] DELETE /identity/v3/projects/710d4deaba2b45fdb21c6febad57ce13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:40.718508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.718796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.719068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.752724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:40.754180 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:40.842623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1233/2448] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:21:40.851914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.852352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.852789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.876538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:40.877898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:40.886666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1216/2449] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:21:40.890807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:40.901084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6295-0c55-4c95-9fad-69b0bca9a9ec None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:40.906322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:40.906986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.907481 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.907786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.908521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:21:40.908821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:40.910461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:40.922687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1234/2450] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:21:40.927105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:40.940040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8183-c1b8-4df9-82e7-4ad69d1a905b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:40.944690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:40.945412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:40.945756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:40.946094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:40.946954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:40.948963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:40.978516 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1217/2451] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:21:40 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:40.982408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:40.992523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9ee1-1f38-4414-8355-a9ca21da749f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:41.046433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:41.047100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.047377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.047645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.048331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:41.050238 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:41.082345 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1235/2452] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:21:40 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:41.085331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:41.096782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbe93-d46a-4775-846f-fe57819e8557 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:41.101899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:41.102920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.103332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.103734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.104846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:41.107023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:41.117466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1218/2453] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:41.121479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:41.132218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d282b-c80b-4c68-a33f-a0bf139eec41 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:41.137052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:41.137889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.138166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.138466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.139182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:41.140836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42627d8-8d2c-4a63-ab5d-f3ad6925d667 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:41.150588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1236/2454] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:41.154956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:41.165159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8861b-e18c-4e61-ae8a-fe6875ca3968 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:41.170355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:41.171241 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.171523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.171920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] PATH_INFO: `/v3/projects/22582cd82fe54b6da78a0ac454a2ea97/users/506a4545503e4f00a1e462d65a30d383/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.187114 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=22582cd82fe54b6da78a0ac454a2ea97, user_id=506a4545503e4f00a1e462d65a30d383, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:41.189779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:41.204201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1219/2455] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:21:41 2022] PUT /identity/v3/projects/22582cd82fe54b6da78a0ac454a2ea97/users/506a4545503e4f00a1e462d65a30d383/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:41.214511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.214798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.215096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.242081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] MFA Rules not processed for user `506a4545503e4f00a1e462d65a30d383`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:41.243404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:41.308705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1237/2456] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:41.319634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:41.321376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:41.403467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97095bc0-5f15-4304-9cd2-9bdcd0d4aecf admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:41.407393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:41.408039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:41.408315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:41.408586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:41.419205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:41.420743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad76284-1152-4f8a-8b1b-216d14573bb2 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:41.431650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1220/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:55.038890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:55.104078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946cba0-4e81-4ea0-b937-835a8b83a773 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:55.109088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:55.109953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.110246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.110545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] PATH_INFO: `/v3/users/506a4545503e4f00a1e462d65a30d383` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.111786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506a4545503e4f00a1e462d65a30d383)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:55.113775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:55.164137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506a4545503e4f00a1e462d65a30d383'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.173507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506a4545503e4f00a1e462d65a30d383'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.174206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506a4545503e4f00a1e462d65a30d383'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.174991 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506a4545503e4f00a1e462d65a30d383'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.186908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506a4545503e4f00a1e462d65a30d383'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.199262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1238/2458] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:21:55 2022] DELETE /identity/v3/users/506a4545503e4f00a1e462d65a30d383 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:55.204619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.205169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.205169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.223228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:55.224422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:55.284163 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1221/2459] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:55.294685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:55.297076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:55.363319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617b7b-4348-4173-b588-d85d11ec7663 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:55.368314 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:55.368977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.369254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.369520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.380000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:55.381416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ccb72-7c29-4f88-be87-08a5bfddde17 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:55.391087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1239/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:55.662370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:55.663965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:55.677474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cde80d-4f73-43f5-8a33-a83870179700 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:55.683099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:55.684170 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.684619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.685078 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] PATH_INFO: `/v3/projects/22582cd82fe54b6da78a0ac454a2ea97` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.686407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22582cd82fe54b6da78a0ac454a2ea97)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:55.688414 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:55.741829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22582cd82fe54b6da78a0ac454a2ea97', 'request_id': 'req-3b737e53-3733-4ac1-ac3e-98edba34b5d6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.749466 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22582cd82fe54b6da78a0ac454a2ea97', 'request_id': 'req-3b737e53-3733-4ac1-ac3e-98edba34b5d6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.755446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22582cd82fe54b6da78a0ac454a2ea97', 'request_id': 'req-3b737e53-3733-4ac1-ac3e-98edba34b5d6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.769398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] The token cache is being invalidate because project 22582cd82fe54b6da78a0ac454a2ea97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:21:55.769693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.770381 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3b737e53-3733-4ac1-ac3e-98edba34b5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:21:55.772105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1222/2461] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:21:55 2022] DELETE /identity/v3/projects/22582cd82fe54b6da78a0ac454a2ea97 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:55.777474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.777832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.778127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.803439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:55.805890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:55.887196 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1240/2462] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:55.891650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.891927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.892206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.912103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:55.913512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:55.923238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1223/2463] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:55.927280 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:55.939849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29fa82-d619-4096-884a-1433737275b8 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:55.945116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:55.945639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.945983 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.946340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.947127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:21:55.947780 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:55.949187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:55.966341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1241/2464] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:21:55.967809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:55.977399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527fe8-81cd-497e-85fb-3a28cf4c14e5 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:55.982267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:55.982976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:55.983248 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:55.983519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:55.984334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:55.986282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.014102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1224/2465] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:21:55 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:56.018419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.028522 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779db8-c6db-4196-a731-3c0e85c64758 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.084986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.085684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.086170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.086474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.087167 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.089105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.111667 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1242/2466] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:21:56 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:21:56.115848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.127058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c7599-4cd3-4f5d-9db3-2f5fbe98ec4e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.131910 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.132606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.132934 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.133186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.133962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.135617 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.146603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1225/2467] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:56.150680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.160698 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff87c-b867-43ee-8f3c-a7fea39169ff admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.165483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.166158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.166480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.166741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.167483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.169120 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed0f02-28b8-42d4-81a5-7056e413a017 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.178963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1243/2468] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:56.183194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.193514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2ced-d212-454b-bd38-2f33355909e7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.199370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.200275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.200553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.200825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] PATH_INFO: `/v3/projects/99a791339ac5471aa7fe07f44aac4f06/users/5bc8619ac87e4cc6a33dd524d244086b/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.216731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a791339ac5471aa7fe07f44aac4f06, user_id=5bc8619ac87e4cc6a33dd524d244086b, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.219412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.234643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1226/2469] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:21:56 2022] PUT /identity/v3/projects/99a791339ac5471aa7fe07f44aac4f06/users/5bc8619ac87e4cc6a33dd524d244086b/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:56.245073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.245363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.245639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.273084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] MFA Rules not processed for user `5bc8619ac87e4cc6a33dd524d244086b`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:56.274329 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:56.342370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1244/2470] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:56.346926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.406585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e3816-1c4f-464c-b814-5d1b5b416af4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.412067 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.412719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.413003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.413272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.413956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.415888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.443257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1227/2471] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:21:56 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:56.447485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.458304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c0eec-99bb-4dfa-b672-fa6b8ae2ffb0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.517826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.518529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.518804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.519064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.519741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.521689 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.547828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1245/2472] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:21:56 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:21:56.549031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.559730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9922-7146-4fe2-b280-27e859c3c405 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.564935 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.565596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.565876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.566149 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.566977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.568571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.579962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1228/2473] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:21:56.584392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.601836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619b10-9ca9-4a3d-850c-7cadc7c252a6 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.607450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.608375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.608658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.608972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] PATH_INFO: `/v3/projects/16535354766f414b974f63336a7746ff/users/d8e3f048aa3040419c8342a1298777b3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.624573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16535354766f414b974f63336a7746ff, user_id=d8e3f048aa3040419c8342a1298777b3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.627268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.641096 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1246/2474] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:21:56 2022] PUT /identity/v3/projects/16535354766f414b974f63336a7746ff/users/d8e3f048aa3040419c8342a1298777b3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:21:56.645345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.655625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737c4d5-82d4-4fb2-8652-2fedffc105d5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.713189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.714083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.714467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.714888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.715695 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.717538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e68b29-0179-46b4-bec7-a01db986b36e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.727956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1229/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:21:56.732403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.744337 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56c4f-6a73-499f-83ac-283f366c683d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.749679 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.750796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.751099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.751370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] PATH_INFO: `/v3/projects/16535354766f414b974f63336a7746ff/users/d8e3f048aa3040419c8342a1298777b3/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.753441 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16535354766f414b974f63336a7746ff, user_id=d8e3f048aa3040419c8342a1298777b3, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.756259 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.767677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1247/2476] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:21:56 2022] PUT /identity/v3/projects/16535354766f414b974f63336a7746ff/users/d8e3f048aa3040419c8342a1298777b3/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:21:56.777982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.778283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.778570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.805449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] MFA Rules not processed for user `d8e3f048aa3040419c8342a1298777b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:21:56.806827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:56.885815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1230/2477] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:21:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:21:56.897544 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:56.899405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:56.953486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e67a2-bf72-4b70-b19c-f5cd0998a507 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:56.957403 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:56.958066 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:56.958374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:56.958650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:56.968427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:56.969861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:56.981003 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1248/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:57.067371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:57.078120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a992c6f-1ee3-4adc-bbd5-6bb62304fb65 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:57.082442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:57.083138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:57.083420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:57.083690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:57.139369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:57.140697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:57.149803 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1231/2479] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:21:59.236897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:21:59.238688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:59.294810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681461ff-621c-448b-8a66-dffd968c80dc service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:21:59.298891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:21:59.299523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:21:59.299796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:21:59.300063 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:21:59.301821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:21:59.368075 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:21:59.369523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:21:59.380858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1249/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:00.546010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:00.555828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc3f8-2aa5-4809-9999-4368749fe573 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:00.559924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:00.560571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:00.560850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:00.561121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:00.563159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:00.624726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:00.626282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:00.636642 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1232/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:36.191545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:36.192952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:36.294170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ab41-d79a-49e3-812d-970cfa789ec9 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:36.299444 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:36.300404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:36.300680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:36.301186 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] PATH_INFO: `/v3/users/5410f46266e048f399e60fd3f2d565d1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:36.302598 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5410f46266e048f399e60fd3f2d565d1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:36.304726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:36.368990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5410f46266e048f399e60fd3f2d565d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.386911 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5410f46266e048f399e60fd3f2d565d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.388276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5410f46266e048f399e60fd3f2d565d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.390070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5410f46266e048f399e60fd3f2d565d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.405029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-e28efd81-a4a1-49a3-ab8a-f38fd4f104ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5410f46266e048f399e60fd3f2d565d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.421193 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1250/2482] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:36 2022] DELETE /identity/v3/users/5410f46266e048f399e60fd3f2d565d1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:36.765194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:36.786247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6ab9-dc89-4325-aeaf-af317c399304 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:36.865583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:36.867321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:36.867581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:36.868090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] PATH_INFO: `/v3/projects/d019b2fd38f44fb193bf76b419634a16` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:36.869474 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d019b2fd38f44fb193bf76b419634a16)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:36.871868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:36.941705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd019b2fd38f44fb193bf76b419634a16', 'request_id': 'req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.948102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd019b2fd38f44fb193bf76b419634a16', 'request_id': 'req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.954465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd019b2fd38f44fb193bf76b419634a16', 'request_id': 'req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.978762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] The token cache is being invalidate because project d019b2fd38f44fb193bf76b419634a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:36.979130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.980902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:36.984500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1233/2483] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:36 2022] DELETE /identity/v3/projects/d019b2fd38f44fb193bf76b419634a16 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:38.642548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf529480-e886-4d1a-b729-61cec0c9b4ae None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:38.643117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf529480-e886-4d1a-b729-61cec0c9b4ae None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:38.643117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf529480-e886-4d1a-b729-61cec0c9b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:38.661760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-bf529480-e886-4d1a-b729-61cec0c9b4ae None None] MFA Rules not processed for user `e69d0561fe714fab9b7171faf257742c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:38.663112 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bf529480-e886-4d1a-b729-61cec0c9b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:38.722504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1251/2484] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:42.501991 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:42.503565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:42.569066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0f99-7e1a-4f6e-a968-25c02d4a7cdf admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:42.574582 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:42.576259 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:42.576547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:42.576826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] PATH_INFO: `/v3/users/5bc8619ac87e4cc6a33dd524d244086b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:42.578356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc8619ac87e4cc6a33dd524d244086b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:42.580895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:42.629734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc8619ac87e4cc6a33dd524d244086b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:42.637229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc8619ac87e4cc6a33dd524d244086b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:42.637952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc8619ac87e4cc6a33dd524d244086b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:42.646297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc8619ac87e4cc6a33dd524d244086b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:42.664327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc8619ac87e4cc6a33dd524d244086b'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:42.671438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1234/2485] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:42 2022] DELETE /identity/v3/users/5bc8619ac87e4cc6a33dd524d244086b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:42.676697 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d881a-dff7-4b35-baff-40ee3737093e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:42.677754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d881a-dff7-4b35-baff-40ee3737093e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:42.678210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d881a-dff7-4b35-baff-40ee3737093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:42.696447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-809d881a-dff7-4b35-baff-40ee3737093e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:42.697745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-809d881a-dff7-4b35-baff-40ee3737093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:42.765796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1252/2486] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:42.778060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:42.779808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:42.837059 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6795d-83e1-4238-ab4b-023fbbc30526 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:42.840950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:42.841702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:42.842054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:42.842436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:42.852040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:42.853576 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:42.864230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1235/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:22:43.078369 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:43.078785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:43.079372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:43.114670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] MFA Rules not processed for user `8fe6db1f6d934ba0bd95826e6c76c556`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:43.116124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:43.177141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1253/2488] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:43.263064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:43.264579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:43.277382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38a1e-d7e9-441c-9e38-7aaabfd721d8 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:43.282174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:43.283117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:43.283425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:43.283702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] PATH_INFO: `/v3/projects/99a791339ac5471aa7fe07f44aac4f06` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:43.285099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a791339ac5471aa7fe07f44aac4f06)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:43.287158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:43.337769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a791339ac5471aa7fe07f44aac4f06', 'request_id': 'req-ffb8d7de-5793-4979-889d-ac93ce724c32'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.343967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a791339ac5471aa7fe07f44aac4f06', 'request_id': 'req-ffb8d7de-5793-4979-889d-ac93ce724c32'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.349179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a791339ac5471aa7fe07f44aac4f06', 'request_id': 'req-ffb8d7de-5793-4979-889d-ac93ce724c32'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.363284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] The token cache is being invalidate because project 99a791339ac5471aa7fe07f44aac4f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:43.363596 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.364293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.366699 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1236/2489] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:43 2022] DELETE /identity/v3/projects/99a791339ac5471aa7fe07f44aac4f06 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:22:43.370848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:43.382499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c0ae2-bfbf-4f5f-8246-27c72d458471 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:43.437564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:43.438483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:43.438768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:43.439044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] PATH_INFO: `/v3/users/d8e3f048aa3040419c8342a1298777b3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:43.440325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e3f048aa3040419c8342a1298777b3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:43.442278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:43.489177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e3f048aa3040419c8342a1298777b3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.498281 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e3f048aa3040419c8342a1298777b3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.499344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e3f048aa3040419c8342a1298777b3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.500008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e3f048aa3040419c8342a1298777b3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.511437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1b834ae8-a434-47d9-8cc9-a872e29a8619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e3f048aa3040419c8342a1298777b3'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.523189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1254/2490] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:43 2022] DELETE /identity/v3/users/d8e3f048aa3040419c8342a1298777b3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:43.793799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:43.796076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:43.814969 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d7de-5793-4979-889d-ac93ce724c32 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:43.884844 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:43.885989 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:43.886504 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:43.886783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] PATH_INFO: `/v3/projects/16535354766f414b974f63336a7746ff` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:43.888001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=16535354766f414b974f63336a7746ff)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:43.889918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:43.940714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16535354766f414b974f63336a7746ff', 'request_id': 'req-a12e66de-d89c-45c8-839f-a9a58e7535fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.946950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16535354766f414b974f63336a7746ff', 'request_id': 'req-a12e66de-d89c-45c8-839f-a9a58e7535fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.952505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16535354766f414b974f63336a7746ff', 'request_id': 'req-a12e66de-d89c-45c8-839f-a9a58e7535fa'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.965281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] The token cache is being invalidate because project 16535354766f414b974f63336a7746ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:43.965587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.966187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-a12e66de-d89c-45c8-839f-a9a58e7535fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:43.967762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1237/2491] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:43 2022] DELETE /identity/v3/projects/16535354766f414b974f63336a7746ff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:43.972749 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:43.973282 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:43.973387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:43.992340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:43.993730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:44.061130 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1255/2492] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:44.068916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.069205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.069479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.090518 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:44.091761 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:44.102286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1238/2493] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:44.104264 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.114674 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648022f-7f71-43da-bebb-0037ba868a89 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.119524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.120204 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.120485 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.120760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.121534 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:22:44.121842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.124172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.141319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1256/2494] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:22:44.142566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.153023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bf401-6277-4738-8287-f0d63b648102 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.161567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.162891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.163468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.163995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.164904 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.167350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.206026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1239/2495] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:22:44.208878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.221319 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56615e-8444-44d1-b546-61c7c7d4e03d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.302917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.303894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.304187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.304466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.305336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.307889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.334232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1257/2496] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:44.338302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.361202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09140-a64f-42f7-91c9-f05e583d7ee5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.368240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.368954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.371017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.371295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.372700 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.376549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.389515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1240/2497] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:44.394452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.408664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50ee6-4556-446d-988f-5b01d1dd94b4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.413706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.414464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.414758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.415012 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.415772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.417699 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cb29-787c-47b5-a5b3-bb0f119e81dc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.429718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1258/2498] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:44.433770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.446886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b0ee-6df3-4bd2-ae14-1c722d25c425 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.457134 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.459097 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.459380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.459656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] PATH_INFO: `/v3/projects/1a3a633231734f46978a81986dedac61/users/e8cd1bece7b54cf183d74d1c1898f861/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.481762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3a633231734f46978a81986dedac61, user_id=e8cd1bece7b54cf183d74d1c1898f861, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.484728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.508886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1241/2499] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:44 2022] PUT /identity/v3/projects/1a3a633231734f46978a81986dedac61/users/e8cd1bece7b54cf183d74d1c1898f861/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:44.519284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.519589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.520086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.550454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] MFA Rules not processed for user `e8cd1bece7b54cf183d74d1c1898f861`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:44.551791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:44.625036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1259/2500] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:22:44.629511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.690369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323e32-cc38-4fe9-8b86-9ed12607ff77 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.695351 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.696011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.696289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.696566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.697274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.699233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.725330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1242/2501] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:44.729474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.740343 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51fb6-5e34-49d7-be32-5b41636f596d None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.795886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.796584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.796866 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.797131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.797812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.799881 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.821643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1260/2502] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:22:44 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:22:44.825688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.836327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c69f-537b-4335-acae-0344a08683b3 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.841349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.841965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.842247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.842546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.843307 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.844920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.855665 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1243/2503] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:44.859695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.869632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc96d-fd63-4f30-8b7f-145f6949d412 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.875029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.875934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.876218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.876508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] PATH_INFO: `/v3/projects/e15a5e7ecee8408aa57e3f11a6466606/users/36571046fa9746b0bb77b4b1f747606d/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:44.892822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15a5e7ecee8408aa57e3f11a6466606, user_id=36571046fa9746b0bb77b4b1f747606d, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:44.895677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:44.915717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1261/2504] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:44 2022] PUT /identity/v3/projects/e15a5e7ecee8408aa57e3f11a6466606/users/36571046fa9746b0bb77b4b1f747606d/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:44.919561 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:44.931355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02024e75-5af4-4c08-89ab-fdf664e4af9c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:44.997413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:44.998281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:44.998745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:44.999422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.003674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.005587 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ee251-baa4-4aa6-87d9-252fb23141cb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.018406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1244/2505] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:22:45.022580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.035201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa6f4-52ae-49c1-ada6-7a90e6fee3ca admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.042964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.044892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.045386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.046357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] PATH_INFO: `/v3/projects/e15a5e7ecee8408aa57e3f11a6466606/users/36571046fa9746b0bb77b4b1f747606d/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.049542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15a5e7ecee8408aa57e3f11a6466606, user_id=36571046fa9746b0bb77b4b1f747606d, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.053092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.064283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1262/2506] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:45 2022] PUT /identity/v3/projects/e15a5e7ecee8408aa57e3f11a6466606/users/36571046fa9746b0bb77b4b1f747606d/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:22:45.075294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.075869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.076329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.106593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] MFA Rules not processed for user `36571046fa9746b0bb77b4b1f747606d`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:45.108085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.192040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1245/2507] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:45.207082 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.208996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.265550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16ccfb-a165-4bde-854d-1a0765bacc76 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.269215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.269868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.270143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.270440 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.279549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.280903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.290498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1263/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:45.570434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.571860 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.610962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.621078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1fa92-fb60-4e5e-a200-76fbe92e840d service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.632206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36571046fa9746b0bb77b4b1f747606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e15a5e7ecee8408aa57e3f11a6466606', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.632869 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.633148 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.633419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.634144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:22:45.636049 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.637884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.651933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1264/2509] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:22:45.655681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.656033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded981e4-743e-4404-8c87-d85ef9057f6e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.659975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.660625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.660900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.661169 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.663236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.668650 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079caca-c8a4-4a10-a800-2843fa72e5d2 tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.673460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36571046fa9746b0bb77b4b1f747606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e15a5e7ecee8408aa57e3f11a6466606', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.674477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.675104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.675104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.675731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.678005 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.706841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1265/2510] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:45 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:45.710621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.712232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.740520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.742410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.768081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1246/2511] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:45.768081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.778617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6eb5-0a39-478f-9a6d-ed2098dfba2a tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.780111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59e4c-60bb-475c-a99d-a0ea326dd449 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.782923 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.783781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.784720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.785155 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.789961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:45.862865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36571046fa9746b0bb77b4b1f747606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e15a5e7ecee8408aa57e3f11a6466606', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.863551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.864230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.864720 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.865597 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:22:45.866074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.867884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.882154 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1247/2512] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:22:45.890474 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.891630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:45.914434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1266/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:45.928868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:45.941176 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d494cc-9a07-4898-b64d-5f47a5660f1d tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:45.946004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36571046fa9746b0bb77b4b1f747606d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e15a5e7ecee8408aa57e3f11a6466606', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:45.946992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:45.947485 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:45.948118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] PATH_INFO: `/v3/projects/d96cf0c07ed547269fdc1ae6e3490d76` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:45.949334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d96cf0c07ed547269fdc1ae6e3490d76)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:45.951499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:46.005742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96cf0c07ed547269fdc1ae6e3490d76', 'request_id': 'req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.014735 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96cf0c07ed547269fdc1ae6e3490d76', 'request_id': 'req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.020534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96cf0c07ed547269fdc1ae6e3490d76', 'request_id': 'req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.037207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] The token cache is being invalidate because project d96cf0c07ed547269fdc1ae6e3490d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:46.037491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.038202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-c6bfa8b7-6fc9-46cb-8c56-c1e726ef04cc tempest-VolumeQuotaClassesTest-1148644009 tempest-VolumeQuotaClassesTest-1148644009-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.040050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1248/2514] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:45 2022] DELETE /identity/v3/projects/d96cf0c07ed547269fdc1ae6e3490d76 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:46.315258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:46.419505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b014c-691a-4be0-a6f6-d4526e883f40 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:46.493134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:46.494478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:46.495374 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:46.495715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] PATH_INFO: `/v3/users/e8cd1bece7b54cf183d74d1c1898f861` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:46.497038 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cd1bece7b54cf183d74d1c1898f861)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:46.500067 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:46.550914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cd1bece7b54cf183d74d1c1898f861'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.559761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cd1bece7b54cf183d74d1c1898f861'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.560644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cd1bece7b54cf183d74d1c1898f861'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.561351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cd1bece7b54cf183d74d1c1898f861'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.574604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cd1bece7b54cf183d74d1c1898f861'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:46.592174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1267/2515] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:46 2022] DELETE /identity/v3/users/e8cd1bece7b54cf183d74d1c1898f861 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:46.594225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:46.594543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:46.594821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:46.612457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:46.613686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:46.713148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1249/2516] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:46.723813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:46.726340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:46.798553 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67241-7508-41c2-ad5c-32111a3573e2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:46.804084 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:46.804777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:46.805052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:46.805322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:46.818248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:46.820350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:46.836419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1268/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:47.209271 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:47.210777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:47.228962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd2d10-939b-4ec2-bed7-c02498936961 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:47.233789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:47.234697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:47.235073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:47.235250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] PATH_INFO: `/v3/projects/1a3a633231734f46978a81986dedac61` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:47.236442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3a633231734f46978a81986dedac61)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:47.238425 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:47.288040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3a633231734f46978a81986dedac61', 'request_id': 'req-0928e2b6-c017-4495-854e-f112ff71e425'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.294249 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3a633231734f46978a81986dedac61', 'request_id': 'req-0928e2b6-c017-4495-854e-f112ff71e425'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.299851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3a633231734f46978a81986dedac61', 'request_id': 'req-0928e2b6-c017-4495-854e-f112ff71e425'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.319288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] The token cache is being invalidate because project 1a3a633231734f46978a81986dedac61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:47.319553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.320200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.321819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1250/2518] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:47 2022] DELETE /identity/v3/projects/1a3a633231734f46978a81986dedac61 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:47.326518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:47.336898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042761ec-0e82-47f3-84ab-308911469af4 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:47.396002 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:47.397727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:47.397880 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:47.398132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] PATH_INFO: `/v3/users/36571046fa9746b0bb77b4b1f747606d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:47.399483 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36571046fa9746b0bb77b4b1f747606d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:47.401380 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:47.451552 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36571046fa9746b0bb77b4b1f747606d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.459755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36571046fa9746b0bb77b4b1f747606d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.460392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36571046fa9746b0bb77b4b1f747606d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.461058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36571046fa9746b0bb77b4b1f747606d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.475267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-d0f244f4-acf8-4843-9900-6112de4b68a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36571046fa9746b0bb77b4b1f747606d'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.490546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1269/2519] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:47 2022] DELETE /identity/v3/users/36571046fa9746b0bb77b4b1f747606d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:47.808472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:47.810029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:47.824537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e2b6-c017-4495-854e-f112ff71e425 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:47.880310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:47.881167 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:47.881443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:47.881712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] PATH_INFO: `/v3/projects/e15a5e7ecee8408aa57e3f11a6466606` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:47.882919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15a5e7ecee8408aa57e3f11a6466606)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:47.884868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:47.930368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15a5e7ecee8408aa57e3f11a6466606', 'request_id': 'req-5b4ebaf7-b9ac-4413-abed-cb218cf71070'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.936799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15a5e7ecee8408aa57e3f11a6466606', 'request_id': 'req-5b4ebaf7-b9ac-4413-abed-cb218cf71070'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.942372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15a5e7ecee8408aa57e3f11a6466606', 'request_id': 'req-5b4ebaf7-b9ac-4413-abed-cb218cf71070'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.955914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] The token cache is being invalidate because project e15a5e7ecee8408aa57e3f11a6466606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:47.956218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.956827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-5b4ebaf7-b9ac-4413-abed-cb218cf71070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:47.958419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1251/2520] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:47 2022] DELETE /identity/v3/projects/e15a5e7ecee8408aa57e3f11a6466606 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:47.963513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:47.963808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:47.964081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:47.984748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:47.985876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:48.043300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1270/2521] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:22:48.051204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.051489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.051767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.071004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:48.072179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:48.081564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1252/2522] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:48.086228 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.096653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acc74-abfb-443c-a54c-99d4b21d3c28 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.101507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.102165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.102473 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.102738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.103465 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:22:48.103762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.105426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.116796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1271/2523] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:22:48.121174 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.131749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f9bf6-bdfb-4d6f-a991-c635708eca1a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.136879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.137551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.137830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.138092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.138825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.140719 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.171024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1253/2524] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:48.172198 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.182382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092128-b60d-4d7d-b260-bb518014a16b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.243427 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.244052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.244876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.244876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.245283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.247272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.270981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1272/2525] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:22:48.275541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.286156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfb5d5-a001-449c-9bfe-9261b89ab2be admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.290817 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.291514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.291806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.292186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.293093 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.294706 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.456995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1254/2526] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:22:48.461170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.471577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b113-4e2e-47a8-a9ce-cfe563160e18 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.476742 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.477458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.477878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.478154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.478932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.480564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd04ca-65c2-4d91-ba8b-d73587670d6d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.491056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1273/2527] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:48.495675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.507551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5fa07-67d9-4ce2-87ea-6731113d66d2 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.513849 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.514771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.515046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.515313 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] PATH_INFO: `/v3/projects/6856f34c5baa4c2e97fe9357247e5f0a/users/5b1e1fbe358a4fc997cd980fe741e068/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.529565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6856f34c5baa4c2e97fe9357247e5f0a, user_id=5b1e1fbe358a4fc997cd980fe741e068, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.532404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.548076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1255/2528] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:48 2022] PUT /identity/v3/projects/6856f34c5baa4c2e97fe9357247e5f0a/users/5b1e1fbe358a4fc997cd980fe741e068/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:48.558368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.558770 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.559111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.584872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] MFA Rules not processed for user `5b1e1fbe358a4fc997cd980fe741e068`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:48.586141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:48.651725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1274/2529] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:48.656161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.716112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff16485-cdb0-4859-8249-78cf043f8262 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.721396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.722063 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.722401 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.722682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.723372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.725318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.753782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1256/2530] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:48.757864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.769365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00114bb6-0dc4-4b29-b9f7-9e302ef3d173 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.826684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.827377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.827655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.827946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.828729 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.830720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.851703 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1275/2531] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:22:48 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:48.855820 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.866155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6de9-2c0b-4910-a6fe-c18a2f86f93a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.870884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.871563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.871841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.872092 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.872826 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.874987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.885274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1257/2532] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:48.889596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.900720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532096bc-013f-449e-b553-d668d1334976 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:48.905730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:48.906658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:48.906936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:48.907221 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] PATH_INFO: `/v3/projects/75a761a944c84928b633b577dd9aea29/users/f1e8331fe9244e22bb4c6eb8d4e75af0/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:48.921980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a761a944c84928b633b577dd9aea29, user_id=f1e8331fe9244e22bb4c6eb8d4e75af0, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:48.924739 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:48.939942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1276/2533] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:48 2022] PUT /identity/v3/projects/75a761a944c84928b633b577dd9aea29/users/f1e8331fe9244e22bb4c6eb8d4e75af0/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:22:48.944189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:48.954116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000f631-0697-4622-b261-34cccfa91aa0 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:49.007085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:49.007669 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:49.007954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:49.008222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:49.008954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:49.010583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81e989-9de5-4733-a89f-abdf4dda8771 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:49.022708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1258/2534] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:49.027124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:49.038177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1323-efed-40c9-a209-79c1250bb8ee admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:49.043613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:49.044508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:49.044785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:49.045057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] PATH_INFO: `/v3/projects/75a761a944c84928b633b577dd9aea29/users/f1e8331fe9244e22bb4c6eb8d4e75af0/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:49.047396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a761a944c84928b633b577dd9aea29, user_id=f1e8331fe9244e22bb4c6eb8d4e75af0, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:49.050187 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:49.061622 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1277/2535] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:49 2022] PUT /identity/v3/projects/75a761a944c84928b633b577dd9aea29/users/f1e8331fe9244e22bb4c6eb8d4e75af0/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:49.072917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:49.073208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:49.073481 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:49.102056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] MFA Rules not processed for user `f1e8331fe9244e22bb4c6eb8d4e75af0`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:49.103325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:49.172068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1259/2536] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:49.184681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:49.186777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:49.245993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d270bc-c368-4e9e-a12b-c3230fc12b84 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:49.250048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:49.250735 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:49.251017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:49.251289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:49.260325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:49.261696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:49.271097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1278/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:49.370441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:49.381302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6abe5-316e-4107-a1f7-20e40b82c385 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:49.385871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:49.386546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:49.386822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:49.387098 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:49.453698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:49.455181 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a0870-3f81-4d7b-94d3-e0f09af79e7a service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:49.464668 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1260/2538] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:52.030491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:52.093342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5204419-bb55-460c-821d-7be0fc410df5 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:52.097926 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:52.100316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:52.100316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:52.100589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] PATH_INFO: `/v3/users/5b1e1fbe358a4fc997cd980fe741e068` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:52.101786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1e1fbe358a4fc997cd980fe741e068)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:52.103760 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:52.166601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1e1fbe358a4fc997cd980fe741e068'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.177692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1e1fbe358a4fc997cd980fe741e068'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.178504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1e1fbe358a4fc997cd980fe741e068'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.179200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1e1fbe358a4fc997cd980fe741e068'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.193945 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1e1fbe358a4fc997cd980fe741e068'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.210162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1279/2539] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:52 2022] DELETE /identity/v3/users/5b1e1fbe358a4fc997cd980fe741e068 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:52.212520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:52.212520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:52.212994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:52.232388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:52.233882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:52.316251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1261/2540] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:52.326744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:52.328376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:52.421970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daf4c4-bb81-4cd6-bd13-08db2023bc87 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:52.426389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:52.427125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:52.427484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:52.428279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:52.440510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:52.442668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:52.453262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1280/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:52.754164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:52.755764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:52.769037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976820c7-5c9a-49a6-8b4d-1ac8d800ae9f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:52.774628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:52.775505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:52.775782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:52.776096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] PATH_INFO: `/v3/projects/6856f34c5baa4c2e97fe9357247e5f0a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:52.777318 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6856f34c5baa4c2e97fe9357247e5f0a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:52.780573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:52.827645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6856f34c5baa4c2e97fe9357247e5f0a', 'request_id': 'req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.833875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6856f34c5baa4c2e97fe9357247e5f0a', 'request_id': 'req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.839210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6856f34c5baa4c2e97fe9357247e5f0a', 'request_id': 'req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.852396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] The token cache is being invalidate because project 6856f34c5baa4c2e97fe9357247e5f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:52.852688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.853325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.854889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1262/2542] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:52 2022] DELETE /identity/v3/projects/6856f34c5baa4c2e97fe9357247e5f0a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:52.859022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:52.868856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57076f91-9fb9-4014-8bf4-de51aeb3986a service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:52.923177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:52.924085 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:52.924368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:52.924695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] PATH_INFO: `/v3/users/f1e8331fe9244e22bb4c6eb8d4e75af0` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:52.925922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e8331fe9244e22bb4c6eb8d4e75af0)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:52.927893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:52.977249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e8331fe9244e22bb4c6eb8d4e75af0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.986463 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e8331fe9244e22bb4c6eb8d4e75af0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.987141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e8331fe9244e22bb4c6eb8d4e75af0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.987759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e8331fe9244e22bb4c6eb8d4e75af0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:52.999347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8996a2cd-2fc3-492e-a26d-81816c6e60e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e8331fe9244e22bb4c6eb8d4e75af0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.011169 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1281/2543] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:52 2022] DELETE /identity/v3/users/f1e8331fe9244e22bb4c6eb8d4e75af0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:53.289175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.290792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:53.304722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fc81b-7c1f-4710-874f-a4bdf46fbb75 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.361223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.362150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.362471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.362743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] PATH_INFO: `/v3/projects/75a761a944c84928b633b577dd9aea29` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.363986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a761a944c84928b633b577dd9aea29)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.365902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.415075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a761a944c84928b633b577dd9aea29', 'request_id': 'req-b334490c-1ecf-4e4b-81cb-8f964957b2a3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.420885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a761a944c84928b633b577dd9aea29', 'request_id': 'req-b334490c-1ecf-4e4b-81cb-8f964957b2a3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.427531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a761a944c84928b633b577dd9aea29', 'request_id': 'req-b334490c-1ecf-4e4b-81cb-8f964957b2a3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.442836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] The token cache is being invalidate because project 75a761a944c84928b633b577dd9aea29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:53.443119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.443765 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b334490c-1ecf-4e4b-81cb-8f964957b2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:53.445350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1263/2544] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:53 2022] DELETE /identity/v3/projects/75a761a944c84928b633b577dd9aea29 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:53.450209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.450738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.450918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.470606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:53.471874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:53.533262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1282/2545] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:53.541099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.541415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.541714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.562246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:53.563477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:53.571970 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1264/2546] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:53.576417 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.586498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd554636-98a5-4b54-a30d-09bbcbd93de3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.591334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.592000 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.592275 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.592550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.593278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:22:53.593582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.595341 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.607478 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1283/2547] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:22:53.611791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.621325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0238-33a0-4c2e-89f0-5a1b45d333cc None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.626376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.627035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.627314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.627605 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.628315 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.630279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.657321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1265/2548] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:22:53 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:53.661726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.671763 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcf19-a025-45f7-bea2-e895de02d9e4 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.726271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.726975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.727262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.727547 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.728273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.730194 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.752230 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1284/2549] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:22:53 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:22:53.756505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.766901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c17d0-5a4e-4d86-a0dc-1380f66722f5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.771998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.772652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.772930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.773199 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.773923 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.775548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.786293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1266/2550] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:22:53.790692 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.801105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235268ca-5768-4025-a89e-84b60db751fa admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.807494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.808179 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.808455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.808722 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.809450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.811113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82fd87-b3e3-4579-8878-adfa57b26c2d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.821061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1285/2551] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:22:53.825567 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:53.839920 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e627-92d3-4ef6-be47-58d778fca0c5 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:53.846757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:53.847648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.848121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.848400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] PATH_INFO: `/v3/projects/83193823a67a45eb9841df3170d88ee2/users/ac8bff6399934889a4db20d944904622/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.864673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83193823a67a45eb9841df3170d88ee2, user_id=ac8bff6399934889a4db20d944904622, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:53.867448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:53.884530 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1267/2552] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:22:53 2022] PUT /identity/v3/projects/83193823a67a45eb9841df3170d88ee2/users/ac8bff6399934889a4db20d944904622/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:53.896575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:53.896867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:53.897145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:53.927328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] MFA Rules not processed for user `ac8bff6399934889a4db20d944904622`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:53.928582 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:53.994170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1286/2553] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:54.005893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:54.007628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:54.065082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669992d9-8386-440e-b2ee-3ada2e46d8d1 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:54.068815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:54.069463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:54.069850 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:54.070127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:54.078911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:54.080542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2616ee6-9d6a-41f3-a30a-8107690a46db service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:54.089734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1268/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:54.108644 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:54.169579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703a64e-2dfd-41a0-9191-d9836728ccbc None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:54.174938 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:54.175837 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:54.176113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:54.176378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] PATH_INFO: `/v3/users/ac8bff6399934889a4db20d944904622` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:54.177580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8bff6399934889a4db20d944904622)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:54.179536 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:54.230715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8bff6399934889a4db20d944904622'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.240477 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8bff6399934889a4db20d944904622'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.241363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8bff6399934889a4db20d944904622'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.242117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8bff6399934889a4db20d944904622'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.254267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8bff6399934889a4db20d944904622'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.272100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1287/2555] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:22:54 2022] DELETE /identity/v3/users/ac8bff6399934889a4db20d944904622 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:22:54.276607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:54.276930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:54.277223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:54.295778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:22:54.296651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:54.357788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1269/2556] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:22:54.367486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:54.369026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:54.426705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366233-bf83-4f42-ae7f-a57c5ebe87d0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:54.430963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:54.431631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:54.431908 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:54.432182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:54.442091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:54.443558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:54.453144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1288/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:22:54.718736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:22:54.720545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:22:54.749846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5d2c-e1a4-47c1-a2f7-b844534fbdf0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:22:54.754823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:22:54.755769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:22:54.756116 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:22:54.756468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] PATH_INFO: `/v3/projects/83193823a67a45eb9841df3170d88ee2` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:22:54.757703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83193823a67a45eb9841df3170d88ee2)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:22:54.759714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:22:54.805629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83193823a67a45eb9841df3170d88ee2', 'request_id': 'req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.812052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83193823a67a45eb9841df3170d88ee2', 'request_id': 'req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.817851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83193823a67a45eb9841df3170d88ee2', 'request_id': 'req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.831184 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] The token cache is being invalidate because project 83193823a67a45eb9841df3170d88ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:22:54.831469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.832082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:22:54.833701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1270/2558] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:22:54 2022] DELETE /identity/v3/projects/83193823a67a45eb9841df3170d88ee2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:23:27.626927 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:27.629661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:27.722243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e769-59d5-4d4a-bf99-376ef52700cd service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:27.789298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:27.789942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:27.790217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:27.790516 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:27.792454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:27.848754 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:27.850372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:27.859365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1289/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:23:31.313150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:31.315673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:31.336132 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ecc0-2fc7-44df-a9e1-d4b4a958ff6a admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:31.343272 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:31.343914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:31.344201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:31.344470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:31.346609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:31.404526 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:31.406108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:31.415239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1271/2560] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:23:42.727378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:42.742607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ca30-0cf6-4cc8-9ad6-f476b58ee1b2 service nova] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:42.750798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:42.751797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:42.752308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:42.752875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:42.755998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:42.772771 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:42.775192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3359-6102-438f-a72f-fb6e80d071f0 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:42.805617 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1290/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:23:42.915968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:42.919772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:42.998228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e23f1-64c9-4636-b46b-0769554e74ea service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:43.003942 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:43.004646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:43.004931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:43.005206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:43.007871 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:43.021618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:43.023117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:43.032317 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1272/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:23:48.127168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:48.127652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:48.127741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:48.148378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:23:48.149560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:48.206562 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1291/2563] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:23:48.248377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:48.250273 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:48.331818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bba59-bbca-486d-bc70-fc45de97aeb7 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:48.337779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:48.338461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:48.338725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:48.338999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:48.347525 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:48.349095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563662-75da-4edb-9277-12b0e89b6600 service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:48.358698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1273/2564] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:23:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:23:50.685921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:50.703942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42708c-aa09-4206-aadf-eaae4ff23225 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:50.713531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:50.714422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:50.714776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:50.715122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:50.717254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:50.731842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:50.734100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:50.747131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1292/2565] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:23:56.363334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:56.364412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:56.364851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:56.385254 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:23:56.386877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:23:56.395295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1274/2566] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:23:56.416095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:23:56.428753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5aa1-e4f1-47dc-a854-cca51bded9ad service nova] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:23:56.433834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:23:56.434624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:23:56.434910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:23:56.435365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:23:56.444849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:23:56.446550 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:23:56.455789 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1293/2567] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:24:02.660671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:02.663600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:02.691028 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e406d-966b-41a4-b421-4f2e318c860c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:02.695804 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:02.696906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:02.697353 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:02.697827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:02.699883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:02.710534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:02.712250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:02.727079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1275/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:24:03.136654 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:03.138141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:03.227251 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd28c-a542-4c07-aad2-58091f0cc178 service swift] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:03.234736 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:03.235724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:03.236124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:03.236411 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:03.239149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:03.251969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:03.253640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbbc70-0290-4fd2-bc9c-1fa7317f1c69 service placement] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:03.264367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1294/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:24:04.132207 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:04.143927 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebf7f-301d-40c1-b352-280d2efc3ed3 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:04.148550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:04.149406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:04.149845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:04.150291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:04.152366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:04.237158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:04.239257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:04.253231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1276/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:24:05.047092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:05.047681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:05.047681 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:05.066632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:05.067884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:05.076896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1295/2571] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:24:05.088884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:05.101072 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd1736-7b13-405e-b334-4d3447d7136d service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:05.106211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:05.106948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:05.107225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:05.107693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:05.117195 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:05.118857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:05.128366 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1277/2572] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:24:05.303965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:05.306876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:05.333101 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c8d85-2688-49f7-8485-b4f8d5837e5a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:05.341419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:05.342711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:05.343189 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:05.343668 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] PATH_INFO: `/v3/users/273d848f2fb24c3eb807d5f6bc2a18fa` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:05.346386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273d848f2fb24c3eb807d5f6bc2a18fa)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:05.348423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:05.448712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273d848f2fb24c3eb807d5f6bc2a18fa'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:05.464769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273d848f2fb24c3eb807d5f6bc2a18fa'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:05.465809 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273d848f2fb24c3eb807d5f6bc2a18fa'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:05.466798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273d848f2fb24c3eb807d5f6bc2a18fa'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:05.488266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273d848f2fb24c3eb807d5f6bc2a18fa'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:05.518306 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1296/2573] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:24:05 2022] DELETE /identity/v3/users/273d848f2fb24c3eb807d5f6bc2a18fa => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:05.960785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:05.971638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768298ca-ff85-4f1e-a15e-c4c36d5ab231 service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:06.070069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:06.071027 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:06.071304 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:06.071579 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] PATH_INFO: `/v3/projects/b99ce29c08104e2788002fbd04410b3a` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:06.072776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99ce29c08104e2788002fbd04410b3a)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:06.074749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:06.134179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99ce29c08104e2788002fbd04410b3a', 'request_id': 'req-b95ec11d-9dce-4b01-8b63-ed654952e754'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.141507 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99ce29c08104e2788002fbd04410b3a', 'request_id': 'req-b95ec11d-9dce-4b01-8b63-ed654952e754'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.165220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99ce29c08104e2788002fbd04410b3a', 'request_id': 'req-b95ec11d-9dce-4b01-8b63-ed654952e754'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.182928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] The token cache is being invalidate because project b99ce29c08104e2788002fbd04410b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:24:06.183544 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.184479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.186848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1278/2574] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:24:05 2022] DELETE /identity/v3/projects/b99ce29c08104e2788002fbd04410b3a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:06.191501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:06.193466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:06.215414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f563-0fc2-48b8-8377-d848b0ddebe5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:06.285836 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:06.287153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:06.289713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:06.290077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] PATH_INFO: `/v3/users/b060ec7498004262b2b59dceff6141a0` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:06.291606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b060ec7498004262b2b59dceff6141a0)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:06.293968 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:06.364099 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b060ec7498004262b2b59dceff6141a0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.395388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b060ec7498004262b2b59dceff6141a0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.397290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b060ec7498004262b2b59dceff6141a0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.398611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b060ec7498004262b2b59dceff6141a0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.454649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b060ec7498004262b2b59dceff6141a0'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.479400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1297/2575] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:24:06 2022] DELETE /identity/v3/users/b060ec7498004262b2b59dceff6141a0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:06.737056 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:06.739022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:06.767159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec11d-9dce-4b01-8b63-ed654952e754 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:06.849936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:06.851835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:06.852680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:06.852961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] PATH_INFO: `/v3/projects/9cac0be36d3e4669b05b5b1f30802658` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:06.854335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cac0be36d3e4669b05b5b1f30802658)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:06.865513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:06.936651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cac0be36d3e4669b05b5b1f30802658', 'request_id': 'req-90c817ec-83b0-4629-af82-737316ce2ac7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.943913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cac0be36d3e4669b05b5b1f30802658', 'request_id': 'req-90c817ec-83b0-4629-af82-737316ce2ac7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.950846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cac0be36d3e4669b05b5b1f30802658', 'request_id': 'req-90c817ec-83b0-4629-af82-737316ce2ac7'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.977138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] The token cache is being invalidate because project 9cac0be36d3e4669b05b5b1f30802658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:24:06.977800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.978229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:06.980697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1279/2576] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:24:06 2022] DELETE /identity/v3/projects/9cac0be36d3e4669b05b5b1f30802658 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:09.232844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:09.234479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:09.259134 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594add-fde1-4dae-aee1-e1bb5a066435 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:09.322727 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:09.323725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:09.324072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:09.324431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] PATH_INFO: `/v3/users/8fe6db1f6d934ba0bd95826e6c76c556` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:09.325794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe6db1f6d934ba0bd95826e6c76c556)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:09.327884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:09.380331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe6db1f6d934ba0bd95826e6c76c556'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.389796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe6db1f6d934ba0bd95826e6c76c556'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.390497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe6db1f6d934ba0bd95826e6c76c556'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.391324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe6db1f6d934ba0bd95826e6c76c556'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.410113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-6b449816-6c6b-4355-b811-b1d4216a8f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe6db1f6d934ba0bd95826e6c76c556'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.427247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1298/2577] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:24:09 2022] DELETE /identity/v3/users/8fe6db1f6d934ba0bd95826e6c76c556 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:09.737872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:09.740499 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:09.757384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c817ec-83b0-4629-af82-737316ce2ac7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:09.822633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:09.823890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:09.824347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:09.824779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] PATH_INFO: `/v3/projects/ee6c1373cfca4082bb000ddeb48e6155` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:09.827041 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6c1373cfca4082bb000ddeb48e6155)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:09.829762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:09.904062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6c1373cfca4082bb000ddeb48e6155', 'request_id': 'req-aae424ef-3086-429d-a3af-9e0a4c045cdc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.910846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6c1373cfca4082bb000ddeb48e6155', 'request_id': 'req-aae424ef-3086-429d-a3af-9e0a4c045cdc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.917225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6c1373cfca4082bb000ddeb48e6155', 'request_id': 'req-aae424ef-3086-429d-a3af-9e0a4c045cdc'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.934885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] The token cache is being invalidate because project ee6c1373cfca4082bb000ddeb48e6155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:24:09.935294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.936267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aae424ef-3086-429d-a3af-9e0a4c045cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:24:09.940780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1280/2578] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:24:09 2022] DELETE /identity/v3/projects/ee6c1373cfca4082bb000ddeb48e6155 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:09.943977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:09.944269 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:09.944601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:09.965484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:09.967305 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:10.034405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1299/2579] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:24:10.042741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.043032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.043306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.062396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:10.063619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:10.075622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1281/2580] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:24:10.076338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.086974 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e60e6e-905c-47c8-b0de-cafbe4f808f6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.092276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.093109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.093385 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.093652 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.094556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:24:10.094847 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.096461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.108492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1300/2581] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:24:10.112943 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.122848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af55ff-1639-4b9a-b193-7578c3d208b6 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.128267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.128944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.129225 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.129498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.130209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.132356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.162798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1282/2582] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:24:10.167816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.178589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42096-5d71-4b1b-bc12-b0e93f346566 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.255850 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.256677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.257127 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.257410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.258150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.260145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.285122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1301/2583] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:24:10 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:24:10.289995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.302309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d360e-e5c7-45e7-903b-9f33b07f52c7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.306931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.307692 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.308039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.308630 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.309545 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.311611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.324065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1283/2584] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:24:10.328462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.338724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e9a1-702e-4dbd-b4fa-f40dc5306e4d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.343898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.344769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.345209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.345506 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.346432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.348245 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e34a-5ea5-4129-8c6c-d0bc498971e1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.359220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1302/2585] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:24:10.363279 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.378004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca28bf-bdc3-4905-bb23-3b38ed6bdd76 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.382741 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.383661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.383936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.384203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] PATH_INFO: `/v3/projects/e4fa2d82e12e4804aa63d46684334f71/users/677f2ea9fdab4d24800b9cd386491c11/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.399464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fa2d82e12e4804aa63d46684334f71, user_id=677f2ea9fdab4d24800b9cd386491c11, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.402574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.419275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1284/2586] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:24:10 2022] PUT /identity/v3/projects/e4fa2d82e12e4804aa63d46684334f71/users/677f2ea9fdab4d24800b9cd386491c11/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:24:10.424105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402629-d46f-4338-a383-554ba6d9a80d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.424459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402629-d46f-4338-a383-554ba6d9a80d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.424801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402629-d46f-4338-a383-554ba6d9a80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.444665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d5402629-d46f-4338-a383-554ba6d9a80d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:10.445962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d5402629-d46f-4338-a383-554ba6d9a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:10.506638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1303/2587] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:24:10.516726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:10.518573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:10.575824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7c8b-869d-4adb-aed0-979005d57000 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:10.579565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:10.580252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:10.580495 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:10.580773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:10.590957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:10.592470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:10.603334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1285/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:24:15.383416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db40b43-4ca4-4391-a67a-71261e90401a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:15.383937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db40b43-4ca4-4391-a67a-71261e90401a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:15.384053 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db40b43-4ca4-4391-a67a-71261e90401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:15.411102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9db40b43-4ca4-4391-a67a-71261e90401a None None] MFA Rules not processed for user `677f2ea9fdab4d24800b9cd386491c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:15.412322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9db40b43-4ca4-4391-a67a-71261e90401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:15.481822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1304/2589] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:24:15.493853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:15.496065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:15.571679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73c54-27b7-4662-96d3-0e78ec579d06 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:15.577542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:15.578196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:15.578510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:15.578785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:15.587316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:15.589024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:15.598439 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1286/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 20 16:24:17.654558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60cfa-8295-427d-8233-9b0a3b5e2265 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:17.655111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60cfa-8295-427d-8233-9b0a3b5e2265 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:17.655111 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60cfa-8295-427d-8233-9b0a3b5e2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:17.677557 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2cc60cfa-8295-427d-8233-9b0a3b5e2265 None None] MFA Rules not processed for user `677f2ea9fdab4d24800b9cd386491c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:17.679278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2cc60cfa-8295-427d-8233-9b0a3b5e2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:17.690296 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1305/2591] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:24:18.027557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:18.029074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:18.044407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245fd48-5c2e-4251-bf0a-6e767c9039d7 service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:18.048264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:18.049150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:18.049430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:18.049702 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:18.051737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:18.066175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:18.068016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:18.077205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1287/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:24:20.495177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:20.495683 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:20.495783 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:20.539131 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:24:20.540678 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:20.628834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1306/2593] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:24:20.652613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:20.654574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:20.747236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929992e0-dd7d-4a4c-9c80-f36ef4f62f7b service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:20.753488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:20.754459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:20.754964 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:20.755657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:20.765629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:20.767372 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:20.777868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1288/2594] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:24:21.657378 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:24:21.688975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2a96a-475c-494f-925f-63bc3ad27865 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:24:21.696372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:24:21.697161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:24:21.697539 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:24:21.697935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:24:21.700047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:24:21.724772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:24:21.729092 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:24:21.742570 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1307/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:03.926125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:03.936433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ebe15-a397-4ebe-91db-fb489c0b3a7e service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:03.940666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:03.941445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:03.941726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:03.941994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:03.944030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:03.956537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:03.957963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:03.967819 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1289/2596] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:07.326197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:07.328486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:07.357860 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81f82-9c96-4223-8f6e-02997b20d950 service nova] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:07.362812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:07.363671 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.363947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.364218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] PATH_INFO: `/v3/users/e69d0561fe714fab9b7171faf257742c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.365421 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69d0561fe714fab9b7171faf257742c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:07.367867 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:07.417415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69d0561fe714fab9b7171faf257742c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.425584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69d0561fe714fab9b7171faf257742c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.426244 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69d0561fe714fab9b7171faf257742c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.426998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69d0561fe714fab9b7171faf257742c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.441933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-b5f299a8-e4fc-45f3-bce9-3b362f189912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69d0561fe714fab9b7171faf257742c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.454883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1308/2597] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:07 2022] DELETE /identity/v3/users/e69d0561fe714fab9b7171faf257742c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:07.635023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:07.647810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd644-8ffa-49b3-8c1e-94f640e2e649 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:07.704873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:07.705672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.705949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.706231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] PATH_INFO: `/v3/projects/bd30e021475547fea71a24a023e0fe49` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.707523 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd30e021475547fea71a24a023e0fe49)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:07.709446 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:07.758208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd30e021475547fea71a24a023e0fe49', 'request_id': 'req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.764538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd30e021475547fea71a24a023e0fe49', 'request_id': 'req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.770387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd30e021475547fea71a24a023e0fe49', 'request_id': 'req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.784035 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] The token cache is being invalidate because project bd30e021475547fea71a24a023e0fe49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:07.784306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.784952 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9eb2c4f4-4ebb-4d09-b642-a73b429b5cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:07.786636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1290/2598] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:07 2022] DELETE /identity/v3/projects/bd30e021475547fea71a24a023e0fe49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:07.792404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.792686 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.792978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.810594 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:07.811842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:07.873995 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1309/2599] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:07.882839 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.883104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.883380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.901883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:07.903103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:07.911299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1291/2600] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:07.915887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:07.926313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5b28-4450-489f-9c6a-6ee2cba70db0 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:07.931669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:07.932332 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.932609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.932884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.933638 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:07.933940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:07.935846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:07.951772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1310/2601] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:25:07.952802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:07.962033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5983721-90c1-4bc6-9eac-54a17a4c3361 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:07.966557 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:07.967200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:07.967475 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:07.967736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:07.968441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:07.970411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.005283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1292/2602] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:07 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:25:08.009743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.020182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a787ede-208e-4f54-9224-efd8647de00d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.085377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.086050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.086368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.086634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.087313 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.089316 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.109428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1311/2603] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:08 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:08.113572 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.124246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20275d-d3ed-497a-bb24-23b36e5bd308 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.129178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.129885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.130127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.130497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.131262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.132899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.143070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1293/2604] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:08.147361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.157357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278421-9400-46d4-a209-a3e961bd79dd admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.162602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.163235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.163512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.163781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.164497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.166080 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fdec-7759-46df-80eb-3df3602e9c8a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.176133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1312/2605] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:08.180480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.190345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232cc08-ee11-4b25-abd6-dfb920e5012b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.195038 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.195914 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.196196 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.196551 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] PATH_INFO: `/v3/projects/9b06ef1e204a493eabd52ea77d232498/users/1aba4382c45640f783659026d5979f2c/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.215204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b06ef1e204a493eabd52ea77d232498, user_id=1aba4382c45640f783659026d5979f2c, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.217806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.233034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1294/2606] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:08 2022] PUT /identity/v3/projects/9b06ef1e204a493eabd52ea77d232498/users/1aba4382c45640f783659026d5979f2c/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:08.244124 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.244409 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.244682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.270232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] MFA Rules not processed for user `1aba4382c45640f783659026d5979f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:08.271432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:08.335338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1313/2607] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:08.341309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.403480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971e18-635c-48b5-8f46-f800ada29049 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.410095 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.411052 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.411415 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.411676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.412432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.414429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.450558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1295/2608] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:08 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:08.455210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.466406 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e099e-5a18-4503-b7f7-ae2595f52f71 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.532336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.533019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.533294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.533565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.534272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.536543 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.567691 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1314/2609] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:08 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:08.573121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.585104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6c4c3-5c6e-4a15-93ad-28884fe2c350 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.594109 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.595147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.595455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.595787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.596955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.599386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.614247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1296/2610] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:08.620546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.632653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808b08-f475-47bd-b951-e8510d0c77ca admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.638891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.639929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.642132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.642132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] PATH_INFO: `/v3/projects/9290b1535d694dffa58efa54ecdb3b19/users/64051d547b814d198340f29166563e60/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.658363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9290b1535d694dffa58efa54ecdb3b19, user_id=64051d547b814d198340f29166563e60, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.661090 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.676357 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1315/2611] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:08 2022] PUT /identity/v3/projects/9290b1535d694dffa58efa54ecdb3b19/users/64051d547b814d198340f29166563e60/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:08.681980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.693862 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95d374-0d1d-4f8c-a255-0acabc5625d7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.772005 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.772654 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.772938 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.773211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.773947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.775954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d0933-bc8e-4fff-808c-dbc45c65318c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.789729 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1297/2612] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:08.794163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.805801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eeabd-7759-42e5-9845-2a79a51132b0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:08.812262 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:08.813145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.813450 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.813712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] PATH_INFO: `/v3/projects/9290b1535d694dffa58efa54ecdb3b19/users/64051d547b814d198340f29166563e60/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.815889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9290b1535d694dffa58efa54ecdb3b19, user_id=64051d547b814d198340f29166563e60, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:08.820803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:08.835109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1316/2613] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:08 2022] PUT /identity/v3/projects/9290b1535d694dffa58efa54ecdb3b19/users/64051d547b814d198340f29166563e60/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:08.845745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:08.846037 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:08.846346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:08.872543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] MFA Rules not processed for user `64051d547b814d198340f29166563e60`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:08.873846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:08.946223 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1298/2614] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:08.957694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:08.959704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:09.017733 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b59b6-b8de-43f5-a93c-20baf12d5852 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:09.021887 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:09.022610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.022824 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.023064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.032457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:09.033876 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddcc9b-76e3-4d98-afde-e81791ce2de4 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:09.043190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1317/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:09.105224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:09.167071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b791cac-4d8a-4534-800b-f34918a32191 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:09.171858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:09.172742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.173000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.173269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] PATH_INFO: `/v3/users/1aba4382c45640f783659026d5979f2c` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.174488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aba4382c45640f783659026d5979f2c)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:09.176460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:09.225175 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aba4382c45640f783659026d5979f2c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.232593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aba4382c45640f783659026d5979f2c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.233368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aba4382c45640f783659026d5979f2c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.242987 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aba4382c45640f783659026d5979f2c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.254885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aba4382c45640f783659026d5979f2c'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.260611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1299/2616] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:09 2022] DELETE /identity/v3/users/1aba4382c45640f783659026d5979f2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:09.265611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.265896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.266206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.284480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:09.285660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:09.353586 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1318/2617] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:09.366201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:09.367946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:09.427422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5378c-9791-49b7-915a-ed41f965c3dc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:09.431931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:09.432570 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.432851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.433121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.442608 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:09.444034 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:09.453532 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1300/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:09.734381 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:09.735844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:09.749842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babafb-5b56-43c9-b0b9-6fbc1462c319 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:09.755832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:09.758010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.758163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.758479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] PATH_INFO: `/v3/projects/9b06ef1e204a493eabd52ea77d232498` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.759695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b06ef1e204a493eabd52ea77d232498)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:09.761615 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:09.811839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b06ef1e204a493eabd52ea77d232498', 'request_id': 'req-45afd224-d8f2-43ef-aaa9-eec9266d97b6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.817964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b06ef1e204a493eabd52ea77d232498', 'request_id': 'req-45afd224-d8f2-43ef-aaa9-eec9266d97b6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.827728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b06ef1e204a493eabd52ea77d232498', 'request_id': 'req-45afd224-d8f2-43ef-aaa9-eec9266d97b6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.839256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] The token cache is being invalidate because project 9b06ef1e204a493eabd52ea77d232498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:09.839542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.840207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.841775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1319/2619] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:09 2022] DELETE /identity/v3/projects/9b06ef1e204a493eabd52ea77d232498 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:09.845929 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:09.855627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ef17-5bf1-42a2-bf3b-c659bc580d67 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:09.914536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:09.915409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:09.915684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:09.915954 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] PATH_INFO: `/v3/users/64051d547b814d198340f29166563e60` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:09.917144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=64051d547b814d198340f29166563e60)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:09.919089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:09.967224 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64051d547b814d198340f29166563e60'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.974270 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64051d547b814d198340f29166563e60'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.974978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64051d547b814d198340f29166563e60'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.983265 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64051d547b814d198340f29166563e60'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:09.995058 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-8de3806d-25a1-4052-9fab-5fd7aabbe1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64051d547b814d198340f29166563e60'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.001289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1301/2620] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:09 2022] DELETE /identity/v3/users/64051d547b814d198340f29166563e60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:10.276929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.278896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:10.293412 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afd224-d8f2-43ef-aaa9-eec9266d97b6 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.354284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.355213 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.355490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.355756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] PATH_INFO: `/v3/projects/9290b1535d694dffa58efa54ecdb3b19` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.356948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9290b1535d694dffa58efa54ecdb3b19)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.358907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.405215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9290b1535d694dffa58efa54ecdb3b19', 'request_id': 'req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.410469 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9290b1535d694dffa58efa54ecdb3b19', 'request_id': 'req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.418577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9290b1535d694dffa58efa54ecdb3b19', 'request_id': 'req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.429858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] The token cache is being invalidate because project 9290b1535d694dffa58efa54ecdb3b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:10.430144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.430801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-1701d604-d5fd-49a0-b33f-d6c5d6c6ae2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:10.432346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1320/2621] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:10 2022] DELETE /identity/v3/projects/9290b1535d694dffa58efa54ecdb3b19 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:10.437447 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.437732 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.438007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.457084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:10.458323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:10.516164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1302/2622] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:10.524396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.524693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.524960 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.543839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:10.545024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:10.553883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1321/2623] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:10.558478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.569061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7929402-8cbd-4054-aaec-7880278ee401 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.575745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.576396 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.576673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.576945 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.577671 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:10.577972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.579590 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.591939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1303/2624] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:25:10.596376 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.605764 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b26d-06db-4a35-abb6-e3ba315ef1a1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.610856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.611501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.611782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.612054 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.612793 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.614730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.643672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1322/2625] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:10.649269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.659071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ce819-45c0-4ad0-9fc9-ab825ad12b9b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.720709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.721370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.721652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.721918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.722651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.724591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.745680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1304/2626] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:10.752354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.768270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5348-27b5-400b-bd76-4bdb29f9b995 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.773775 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.774472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.774753 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.775024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.775751 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.777347 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.790551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1323/2627] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:10.794814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.805309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55142b50-9a71-43f6-b51e-b77535697b13 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.810843 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.811491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.811770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.812039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.812759 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.814334 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98aab4-fee8-47c2-bcae-fe65eb03408a admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.824297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1305/2628] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:10.828538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:10.838702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5accb0a-27f8-45d0-ac15-1f05d93254f2 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:10.843977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:10.844856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.845139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.845413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] PATH_INFO: `/v3/projects/c77a74a8f982427d95c04bffd93caed8/users/8fece358766541b2b4a20ec480add1dd/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.859896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77a74a8f982427d95c04bffd93caed8, user_id=8fece358766541b2b4a20ec480add1dd, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:10.862589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:10.877055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1324/2629] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:10 2022] PUT /identity/v3/projects/c77a74a8f982427d95c04bffd93caed8/users/8fece358766541b2b4a20ec480add1dd/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:10.888601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:10.889127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:10.889127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:10.916614 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] MFA Rules not processed for user `8fece358766541b2b4a20ec480add1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:10.917800 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:10.984306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1306/2630] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:10.988942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.056324 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91430b7-c2f0-432b-917e-fbea708f6593 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.062182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.062878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.063156 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.063425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.064107 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.066048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.093858 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1325/2631] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:10 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:11.099517 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.112051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5c3d6-ecbe-47c4-bd98-faf070f81aef None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.176619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.177281 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.177564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.177835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.178565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.180613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.203165 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1307/2632] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:11 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:11.210975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.223842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b593-fbcb-4f35-bf1a-b6a05f4b39f1 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.228797 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.229487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.229752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.230041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.230785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.232400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.242882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1326/2633] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:11.247405 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.257988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbcc76-2a14-445f-b83a-2daeb05cbebc admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.262591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.263476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.263750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.264033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] PATH_INFO: `/v3/projects/05a8e23d978547aeba8092b308c5769b/users/586454b6f78f4f70adc0e3a7af67a0c6/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.278769 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a8e23d978547aeba8092b308c5769b, user_id=586454b6f78f4f70adc0e3a7af67a0c6, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.281398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.296399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1308/2634] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:11 2022] PUT /identity/v3/projects/05a8e23d978547aeba8092b308c5769b/users/586454b6f78f4f70adc0e3a7af67a0c6/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:11.300721 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.311039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235c4c-9213-4d27-a69a-359b5d90247b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.367024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.367682 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.367893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.368199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.368906 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.370529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb9a7c-90ef-4ab7-a235-6814df6da016 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.380657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1327/2635] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:11.385686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.399563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853cd7-418a-4bc5-b244-a168a0d02163 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.405442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.406387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.406666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.406932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] PATH_INFO: `/v3/projects/05a8e23d978547aeba8092b308c5769b/users/586454b6f78f4f70adc0e3a7af67a0c6/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.409117 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a8e23d978547aeba8092b308c5769b, user_id=586454b6f78f4f70adc0e3a7af67a0c6, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.411816 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.422179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1309/2636] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:11 2022] PUT /identity/v3/projects/05a8e23d978547aeba8092b308c5769b/users/586454b6f78f4f70adc0e3a7af67a0c6/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:11.432670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.432958 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.433222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.460786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] MFA Rules not processed for user `586454b6f78f4f70adc0e3a7af67a0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:11.461952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:11.528122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1328/2637] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:11.540457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.543515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:11.611050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960188f1-2261-44f7-b00d-2e3fb7bf44fb admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.615728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.616368 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.616648 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.616915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.627001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.628376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.637501 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1310/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:11.728664 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:11.739217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c18ea0-de31-4075-8aeb-bcce70364e55 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:11.743531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:11.744218 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:11.744608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:11.744897 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:11.806358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:11.808993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45bbbf-a507-4b66-b3fb-7dcf099c989e service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:11.820972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1329/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:16.520082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:16.580822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0355-3897-4222-920e-dab10908c25c service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:16.585845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:16.586772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:16.587055 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:16.587345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] PATH_INFO: `/v3/users/8fece358766541b2b4a20ec480add1dd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:16.588546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fece358766541b2b4a20ec480add1dd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:16.590502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:16.636377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fece358766541b2b4a20ec480add1dd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:16.643010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fece358766541b2b4a20ec480add1dd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:16.643676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fece358766541b2b4a20ec480add1dd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:16.651770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fece358766541b2b4a20ec480add1dd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:16.663652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fece358766541b2b4a20ec480add1dd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:16.669684 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1311/2640] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:16 2022] DELETE /identity/v3/users/8fece358766541b2b4a20ec480add1dd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:16.674537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf5c0-62ee-4dc5-adcd-aeecf98adcd9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:16.675069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf5c0-62ee-4dc5-adcd-aeecf98adcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:16.675069 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf5c0-62ee-4dc5-adcd-aeecf98adcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:16.692710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-315cf5c0-62ee-4dc5-adcd-aeecf98adcd9 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:16.693937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-315cf5c0-62ee-4dc5-adcd-aeecf98adcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:16.754029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1330/2641] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:16.767346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:16.768922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:16.826228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7a1b6-011d-4fb4-88c9-430def477767 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:16.830023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:16.830770 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:16.831118 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:16.831459 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:16.840966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:16.842438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:16.852672 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1312/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:17.170996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:17.171309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:17.171588 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:17.189353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] MFA Rules not processed for user `677f2ea9fdab4d24800b9cd386491c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:17.190609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:17.247173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1331/2643] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:17.277472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:17.278777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:17.293789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80412-c626-42f4-ae86-b59b469b67f8 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:17.299210 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:17.301215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:17.301215 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:17.301718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] PATH_INFO: `/v3/projects/c77a74a8f982427d95c04bffd93caed8` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:17.303136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77a74a8f982427d95c04bffd93caed8)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:17.305426 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:17.355205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77a74a8f982427d95c04bffd93caed8', 'request_id': 'req-02da430a-1288-40b4-866a-11f8b335aa13'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.361294 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77a74a8f982427d95c04bffd93caed8', 'request_id': 'req-02da430a-1288-40b4-866a-11f8b335aa13'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.367084 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77a74a8f982427d95c04bffd93caed8', 'request_id': 'req-02da430a-1288-40b4-866a-11f8b335aa13'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.382457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] The token cache is being invalidate because project c77a74a8f982427d95c04bffd93caed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:17.382795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.383456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.385138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1313/2644] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:17 2022] DELETE /identity/v3/projects/c77a74a8f982427d95c04bffd93caed8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:17.389690 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:17.400086 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b852bd-3cd8-41e0-9d5c-10178cbf0de9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:17.454535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:17.455304 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:17.455584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:17.455849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] PATH_INFO: `/v3/users/586454b6f78f4f70adc0e3a7af67a0c6` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:17.457199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586454b6f78f4f70adc0e3a7af67a0c6)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:17.459150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:17.506046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586454b6f78f4f70adc0e3a7af67a0c6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.513567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586454b6f78f4f70adc0e3a7af67a0c6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.514410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586454b6f78f4f70adc0e3a7af67a0c6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.515048 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586454b6f78f4f70adc0e3a7af67a0c6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.526358 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-2552e424-42c1-4896-82fa-c995707c1192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586454b6f78f4f70adc0e3a7af67a0c6'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.538750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1332/2645] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:17 2022] DELETE /identity/v3/users/586454b6f78f4f70adc0e3a7af67a0c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:17.805534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:17.807733 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:17.820961 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da430a-1288-40b4-866a-11f8b335aa13 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:17.881846 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:17.883017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:17.883400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:17.883774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] PATH_INFO: `/v3/projects/05a8e23d978547aeba8092b308c5769b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:17.885087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a8e23d978547aeba8092b308c5769b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:17.888110 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:17.941637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a8e23d978547aeba8092b308c5769b', 'request_id': 'req-41376572-3718-4dec-841b-bb0e4c2419ac'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.948040 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a8e23d978547aeba8092b308c5769b', 'request_id': 'req-41376572-3718-4dec-841b-bb0e4c2419ac'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.953301 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a8e23d978547aeba8092b308c5769b', 'request_id': 'req-41376572-3718-4dec-841b-bb0e4c2419ac'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.966120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] The token cache is being invalidate because project 05a8e23d978547aeba8092b308c5769b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:17.966412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.967029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-41376572-3718-4dec-841b-bb0e4c2419ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:17.968627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1314/2646] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:17 2022] DELETE /identity/v3/projects/05a8e23d978547aeba8092b308c5769b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:17.973672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:17.974170 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:17.974702 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:17.992737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:17.993948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:18.053161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1333/2647] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:18.060658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.060949 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.061229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.079263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:18.080450 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:18.088771 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1315/2648] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:18.093294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.104961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeacfa7-aba6-455f-be53-7dbdcb3a0a2a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.109601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.110300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.110580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.110894 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.111585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:18.111890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.113548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.125058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1334/2649] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:25:18.130161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.139283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef7e25-5b47-41d4-8886-b0609a6b100e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.146400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.147043 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.147356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.147603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.148295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.150200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.178025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1316/2650] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:18 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:18.182239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.193089 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c61fe-d7f5-4089-8407-3de9581fd87f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.251990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.252604 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.252885 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.253159 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.253884 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.255839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.276804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1335/2651] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:18 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:25:18.281634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.292246 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1c6f-7417-4f37-ab30-df7fd4008f1c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.296892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.297547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.297821 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.298089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.298859 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.300489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.311984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1317/2652] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:18.315989 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.326202 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a10e-8716-474a-8a4a-6df1fc3707db admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.330948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.331611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.331924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.332199 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.332915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.334524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e1110-557c-4afb-a280-3b97b284f933 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.344835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1336/2653] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:18.349140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.359280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4d352-fff5-420f-b938-dda9c657e4a0 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.364394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.365257 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.365549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.365813 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] PATH_INFO: `/v3/projects/8de69db77a9347e98fe31dd67719db25/users/ed65f2ac06794c43a7c217bfebed9d56/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.381267 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de69db77a9347e98fe31dd67719db25, user_id=ed65f2ac06794c43a7c217bfebed9d56, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.383924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.397275 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1318/2654] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:18 2022] PUT /identity/v3/projects/8de69db77a9347e98fe31dd67719db25/users/ed65f2ac06794c43a7c217bfebed9d56/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:18.408429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.408713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.408978 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.436537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] MFA Rules not processed for user `ed65f2ac06794c43a7c217bfebed9d56`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:18.437769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:18.509154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1337/2655] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:18.521201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:18.523062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:18.585108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6b45a-98f1-435b-83a1-290beba48ae4 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:18.592054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:18.592997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:18.593263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:18.593634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:18.603965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:18.605399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591dd7-fa72-43fb-8285-3da615f563fd service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:18.614659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1319/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:36.259386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:36.324694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e6427-4934-4132-a1e7-73ade25b69b1 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:36.329818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:36.330934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:36.331215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:36.331476 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] PATH_INFO: `/v3/users/ed65f2ac06794c43a7c217bfebed9d56` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:36.332718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed65f2ac06794c43a7c217bfebed9d56)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:36.334707 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:36.381929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed65f2ac06794c43a7c217bfebed9d56'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:36.390843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed65f2ac06794c43a7c217bfebed9d56'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:36.391484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed65f2ac06794c43a7c217bfebed9d56'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:36.392068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed65f2ac06794c43a7c217bfebed9d56'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:36.403548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed65f2ac06794c43a7c217bfebed9d56'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:36.415802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1338/2657] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:36 2022] DELETE /identity/v3/users/ed65f2ac06794c43a7c217bfebed9d56 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:36.420589 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07147825-fd40-414f-9c5f-8123691f453b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:36.421128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07147825-fd40-414f-9c5f-8123691f453b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:36.421244 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07147825-fd40-414f-9c5f-8123691f453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:36.438655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-07147825-fd40-414f-9c5f-8123691f453b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:36.440096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-07147825-fd40-414f-9c5f-8123691f453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:36.499727 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1320/2658] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:36.512976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:36.514745 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:36.573443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e5d0-7876-4214-9625-1e6689d7ccca admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:36.577575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:36.578266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:36.578551 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:36.578821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:36.588507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:36.589932 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4bdf4-6458-446e-babb-43c0b67f150a service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:36.599149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1339/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:37.033656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07147825-fd40-414f-9c5f-8123691f453b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.035133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-07147825-fd40-414f-9c5f-8123691f453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:37.047823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07147825-fd40-414f-9c5f-8123691f453b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.054946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.055613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.055895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.056471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] PATH_INFO: `/v3/projects/8de69db77a9347e98fe31dd67719db25` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.057410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de69db77a9347e98fe31dd67719db25)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.059537 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.106477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de69db77a9347e98fe31dd67719db25', 'request_id': 'req-9ded654d-eef7-4a0c-b719-f975d845b3f4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:37.112697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de69db77a9347e98fe31dd67719db25', 'request_id': 'req-9ded654d-eef7-4a0c-b719-f975d845b3f4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:37.118340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de69db77a9347e98fe31dd67719db25', 'request_id': 'req-9ded654d-eef7-4a0c-b719-f975d845b3f4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:37.131586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] The token cache is being invalidate because project 8de69db77a9347e98fe31dd67719db25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:37.131873 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:37.132497 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-9ded654d-eef7-4a0c-b719-f975d845b3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:37.134091 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1321/2660] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:37 2022] DELETE /identity/v3/projects/8de69db77a9347e98fe31dd67719db25 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:37.139286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.139661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.140026 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.157752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:37.158970 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:37.240521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1340/2661] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:37.248412 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.248760 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.249128 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.268613 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:37.269514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:37.277997 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1322/2662] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:37.282723 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.292878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321ffd2-1f0f-450d-b7f7-ac3343481f5f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.303289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.303977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.304283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.304554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.305298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:37.305601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.307503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.320284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1341/2663] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:25:37.324960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.334515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa46c6-57e0-4e32-9bd7-910affdcfbc3 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.339957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.340628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.340905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.341172 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.341863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.343806 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.371044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1323/2664] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:37.375217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.385748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c2d42-6c4a-4a72-ab24-9706a421c0bc admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.444670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.445524 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.445811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.446173 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.446914 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.448857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.474303 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1342/2665] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:25:37.477448 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.487718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2881b-8aaf-45d4-a335-d68a17b9b58d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.492543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.493299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.493643 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.493985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.494828 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.496607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.507863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1324/2666] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:37.512119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.522918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4c2e-35ce-4b30-84db-20ff83cb0ead admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.527861 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.528563 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.528803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.529077 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.529811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.531462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978afdce-a06d-43a5-b875-d1be2d334dba admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.546344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1343/2667] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:37.549874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.560373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d887-4740-45a8-b431-bd799eda0dbb admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.565798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.566740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.567015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.567286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] PATH_INFO: `/v3/projects/2a7392f55a5c444e87aac01e48313ab1/users/61504aaa826240f7816baf4cf6ca40d0/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.582399 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7392f55a5c444e87aac01e48313ab1, user_id=61504aaa826240f7816baf4cf6ca40d0, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.585031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.601872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1325/2668] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:37 2022] PUT /identity/v3/projects/2a7392f55a5c444e87aac01e48313ab1/users/61504aaa826240f7816baf4cf6ca40d0/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:37.613407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.613700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.613972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.641804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] MFA Rules not processed for user `61504aaa826240f7816baf4cf6ca40d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:37.643064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:37.711023 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1344/2669] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:37.715674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.780798 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eff1ac-47e8-4838-927b-d3d639eab973 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.785385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.786018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.786319 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.786591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.787314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.789208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.817314 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1326/2670] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:37.821687 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.833125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ca4b-cde3-4b9e-b38f-f18262940b22 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.887744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.888454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.888765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.889033 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.889725 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.891688 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.911859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1345/2671] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:37.916321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.926585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeebc39-afe1-4f66-aa8d-44d22db401e7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.931161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.931815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.932105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.932365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.933088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.934823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.947618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1327/2672] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:37.948794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.958843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6857-2d56-421d-a54c-00ac7b5a8e8e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.963418 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.964070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.964350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.964621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:37.965404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:37.967029 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda09a41-a8e0-4dc4-af78-1afc88cac506 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:37.976853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1346/2673] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:37.981185 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:37.991189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc811-5f90-4b32-ad4e-3cb6c8258c03 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:37.996284 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:37.997247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:37.997730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:37.997926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] PATH_INFO: `/v3/projects/6bd89f044c3f4b659242771aacfea4a3/users/2b2983d598a74cc2bd8490d61223605f/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.014830 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd89f044c3f4b659242771aacfea4a3, user_id=2b2983d598a74cc2bd8490d61223605f, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.017709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.032573 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1328/2674] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:37 2022] PUT /identity/v3/projects/6bd89f044c3f4b659242771aacfea4a3/users/2b2983d598a74cc2bd8490d61223605f/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:38.043106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.043564 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.043910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.071009 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] MFA Rules not processed for user `2b2983d598a74cc2bd8490d61223605f`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:38.072328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:38.141628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1347/2675] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:38.143187 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.207875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650796f-7469-4ca4-8b83-e30e59280801 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.212679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.213355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.213634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.213902 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.214691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.216751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.243565 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1329/2676] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:38.247852 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.258834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ba5d-102f-4945-85fd-6c96d6f98080 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.313811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.314568 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.314869 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.315135 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.315913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.317895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.340153 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1348/2677] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:38 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:25:38.344115 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.354434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dabbe-99e3-4d44-aaee-8e773ef33a61 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.359731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.360398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.360676 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.361085 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.361810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.363456 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.374550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1330/2678] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:38.379109 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.389283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b602-fcb1-46ca-98bb-6c862e6a5b58 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.394373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.395260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.395540 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.395812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] PATH_INFO: `/v3/projects/09d1f60d20c84859b44cf12903f1dc9c/users/02f15da4fa44495396484c1bd30adf1f/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.410291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d1f60d20c84859b44cf12903f1dc9c, user_id=02f15da4fa44495396484c1bd30adf1f, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.412961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.427097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1349/2679] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:38 2022] PUT /identity/v3/projects/09d1f60d20c84859b44cf12903f1dc9c/users/02f15da4fa44495396484c1bd30adf1f/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:38.431140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.441330 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c91c-55a1-4cba-8672-d866046960bb admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.500365 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.501333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.501661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.502009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.503044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.505500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182adc8a-c7a5-49ca-841e-4bba1ceae23e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.519865 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1331/2680] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:38.524484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.536453 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95942b6-2f26-43ee-9c3a-73a74709c113 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.541361 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.542241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.542579 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.542828 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] PATH_INFO: `/v3/projects/09d1f60d20c84859b44cf12903f1dc9c/users/02f15da4fa44495396484c1bd30adf1f/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.544898 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d1f60d20c84859b44cf12903f1dc9c, user_id=02f15da4fa44495396484c1bd30adf1f, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.547632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.557795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1350/2681] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:38 2022] PUT /identity/v3/projects/09d1f60d20c84859b44cf12903f1dc9c/users/02f15da4fa44495396484c1bd30adf1f/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:38.568122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.568409 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.568703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.596024 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] MFA Rules not processed for user `02f15da4fa44495396484c1bd30adf1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:38.597205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:38.670645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1332/2682] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:38.684940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:38.687059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:38.744098 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9a80-02ce-4f58-98b4-00ab9c2450bb admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:38.748317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:38.748976 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:38.749267 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:38.749584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:38.817571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:38.819870 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:38.831122 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1351/2683] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:40.329764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:40.331377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:40.344788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1930b-84b6-49ca-910b-227d6d6701ab None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:40.349148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:40.349792 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:40.350071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:40.350388 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:40.409392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:40.410928 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:40.420247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1333/2684] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:40.966008 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:40.975331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c7889-62a5-4f1e-abf9-b7c0b267e27f service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:40.979953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:40.980603 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:40.980879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:40.981144 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:40.990985 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:40.992442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62519363-fcbd-4691-964a-8bc84b4aa8b2 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:41.002738 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1352/2685] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:44.894218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:44.958458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60c9f-e0ba-4ecf-8571-c254e51c972f service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:44.963784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:44.964652 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:44.964930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:44.965198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] PATH_INFO: `/v3/users/61504aaa826240f7816baf4cf6ca40d0` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:44.966610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61504aaa826240f7816baf4cf6ca40d0)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:44.968538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:45.016061 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61504aaa826240f7816baf4cf6ca40d0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.022818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61504aaa826240f7816baf4cf6ca40d0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.023569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61504aaa826240f7816baf4cf6ca40d0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.031357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61504aaa826240f7816baf4cf6ca40d0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.042476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61504aaa826240f7816baf4cf6ca40d0'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.048144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1334/2686] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:44 2022] DELETE /identity/v3/users/61504aaa826240f7816baf4cf6ca40d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:45.052871 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:45.053408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:45.053408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:45.072222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:45.073416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:45.136841 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1353/2687] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:25:45.146823 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:45.148269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:45.202560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136854-89ef-4079-9aca-c9ebd42d4b76 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:45.206704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:45.207355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:45.207625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:45.207896 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:45.217142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:45.219057 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:45.229506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1335/2688] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:45.497408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:45.498905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:45.513291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de74322-3fac-411d-83da-35bc81ac75d3 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:45.519051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:45.520094 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:45.520364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:45.520607 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] PATH_INFO: `/v3/projects/2a7392f55a5c444e87aac01e48313ab1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:45.521928 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7392f55a5c444e87aac01e48313ab1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:45.523984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:45.578150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7392f55a5c444e87aac01e48313ab1', 'request_id': 'req-5aff44f0-9d1c-4908-b751-18b7d7303d7b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.583740 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7392f55a5c444e87aac01e48313ab1', 'request_id': 'req-5aff44f0-9d1c-4908-b751-18b7d7303d7b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.592284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7392f55a5c444e87aac01e48313ab1', 'request_id': 'req-5aff44f0-9d1c-4908-b751-18b7d7303d7b'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.603438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] The token cache is being invalidate because project 2a7392f55a5c444e87aac01e48313ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:45.603720 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.604373 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.605924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1354/2689] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:45 2022] DELETE /identity/v3/projects/2a7392f55a5c444e87aac01e48313ab1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:45.610364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:45.620390 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467268-035b-46b1-b2df-88bf32b42ea4 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:45.675906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:45.676842 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:45.677011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:45.677323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] PATH_INFO: `/v3/users/2b2983d598a74cc2bd8490d61223605f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:45.678583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2983d598a74cc2bd8490d61223605f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:45.680540 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:45.728795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2983d598a74cc2bd8490d61223605f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.735458 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2983d598a74cc2bd8490d61223605f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.736131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2983d598a74cc2bd8490d61223605f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.747113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2983d598a74cc2bd8490d61223605f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.759111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2983d598a74cc2bd8490d61223605f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:45.764872 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1336/2690] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:45 2022] DELETE /identity/v3/users/2b2983d598a74cc2bd8490d61223605f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:46.035438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:46.037185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:46.052593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff44f0-9d1c-4908-b751-18b7d7303d7b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:46.115010 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:46.115848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.116162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.116425 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] PATH_INFO: `/v3/projects/6bd89f044c3f4b659242771aacfea4a3` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.117717 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd89f044c3f4b659242771aacfea4a3)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:46.119744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:46.168705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd89f044c3f4b659242771aacfea4a3', 'request_id': 'req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.174759 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd89f044c3f4b659242771aacfea4a3', 'request_id': 'req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.183941 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd89f044c3f4b659242771aacfea4a3', 'request_id': 'req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.194973 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] The token cache is being invalidate because project 6bd89f044c3f4b659242771aacfea4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:46.195257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.195883 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.197432 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1355/2691] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:46 2022] DELETE /identity/v3/projects/6bd89f044c3f4b659242771aacfea4a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:46.201714 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:46.203229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:46.216125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8333b7-2f7f-40c8-8649-7a468cadb676 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:46.272389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:46.273264 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.273546 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.273825 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] PATH_INFO: `/v3/users/02f15da4fa44495396484c1bd30adf1f` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.275087 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f15da4fa44495396484c1bd30adf1f)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:46.277033 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:46.331647 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f15da4fa44495396484c1bd30adf1f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.339044 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f15da4fa44495396484c1bd30adf1f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.339885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f15da4fa44495396484c1bd30adf1f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.349736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f15da4fa44495396484c1bd30adf1f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.361349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e0821461-ecbe-49bd-a15b-243bf92e69c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f15da4fa44495396484c1bd30adf1f'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.367508 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1337/2692] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:46 2022] DELETE /identity/v3/users/02f15da4fa44495396484c1bd30adf1f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:46.655814 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:46.657338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:46.670959 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a107be6-5552-4b9a-b3cc-b4b6fad2274c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:46.735502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:46.736388 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.737174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.737455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] PATH_INFO: `/v3/projects/09d1f60d20c84859b44cf12903f1dc9c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.738888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d1f60d20c84859b44cf12903f1dc9c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:46.740874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:46.789929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d1f60d20c84859b44cf12903f1dc9c', 'request_id': 'req-67590943-8e99-404f-94db-f667454a3551'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.796133 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d1f60d20c84859b44cf12903f1dc9c', 'request_id': 'req-67590943-8e99-404f-94db-f667454a3551'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.805217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d1f60d20c84859b44cf12903f1dc9c', 'request_id': 'req-67590943-8e99-404f-94db-f667454a3551'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.816591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] The token cache is being invalidate because project 09d1f60d20c84859b44cf12903f1dc9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:46.816879 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.817513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-67590943-8e99-404f-94db-f667454a3551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:46.819232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1356/2693] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:46 2022] DELETE /identity/v3/projects/09d1f60d20c84859b44cf12903f1dc9c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:46.824250 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.824538 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.824898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.845946 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:46.847751 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:46.923342 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1338/2694] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:46.931676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.931965 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.932239 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.951466 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:46.952676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:46.961804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1357/2695] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:46.966140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:46.976102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e0c7-3185-4f06-aeab-54f49646a3b7 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:46.986075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:46.986783 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:46.987065 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:46.987331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:46.988090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:46.988395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:46.990011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.003001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1339/2696] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:25:47.008145 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.020711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f030a6-5717-48e1-8da6-0ad5f18ecdb6 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.026605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.027248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.027518 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.027781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.028462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.030375 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.061037 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1358/2697] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:47.066285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.076290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211f41b-a3af-44ba-adc2-befc0b31c610 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.135651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.136303 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.136609 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.136888 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.137583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.139610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.160238 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1340/2698] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:47 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:47.164665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.175460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b2e5-2f37-47a1-be6c-2730ec0cf9c9 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.181154 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.181831 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.182097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.182415 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.183138 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.184744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.195342 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1359/2699] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:47.199389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.209836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a341-a1be-4e33-864c-57c5f2c4cffe admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.215795 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.216465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.216748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.217020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.217745 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.219404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7932712-32e6-4ff3-8e4a-6fedc35242b9 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.230145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1341/2700] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:25:47.234513 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.244454 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856ba5-df33-4b33-a52c-c7e469c619aa admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.249565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.250470 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.251123 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.251389 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] PATH_INFO: `/v3/projects/0bebb3276a1d4568974adb76b9c20967/users/935d0fba6fda4dc1a68376d8c7cb8a48/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.265624 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bebb3276a1d4568974adb76b9c20967, user_id=935d0fba6fda4dc1a68376d8c7cb8a48, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.268315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.282998 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1360/2701] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:47 2022] PUT /identity/v3/projects/0bebb3276a1d4568974adb76b9c20967/users/935d0fba6fda4dc1a68376d8c7cb8a48/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:25:47.293453 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.293748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.294029 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.319986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] MFA Rules not processed for user `935d0fba6fda4dc1a68376d8c7cb8a48`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:47.321189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:47.390548 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1342/2702] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:47.402150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.403890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:47.464951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7e6b-bb61-4dd1-a154-80ba68cb510f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.468865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.469502 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.469786 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.470047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.478291 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.479712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7fc30-2c23-4db9-a37e-340682d03cb4 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.488808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1361/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:47.514433 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.578566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881514f-89f1-4d69-bfdc-f5506e67033b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.584478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.585349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.585634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.585907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] PATH_INFO: `/v3/users/935d0fba6fda4dc1a68376d8c7cb8a48` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.587237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935d0fba6fda4dc1a68376d8c7cb8a48)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.589165 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.641289 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935d0fba6fda4dc1a68376d8c7cb8a48'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:47.647879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935d0fba6fda4dc1a68376d8c7cb8a48'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:47.648542 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935d0fba6fda4dc1a68376d8c7cb8a48'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:47.657007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935d0fba6fda4dc1a68376d8c7cb8a48'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:47.668231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935d0fba6fda4dc1a68376d8c7cb8a48'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:47.673931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1343/2704] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:47 2022] DELETE /identity/v3/users/935d0fba6fda4dc1a68376d8c7cb8a48 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:47.678889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.679182 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.679458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.697712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:47.698946 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:47.767377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1362/2705] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:47.777599 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:47.779331 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:47.847603 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0062-e8fa-47ec-a422-a78ad04f1700 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:47.853963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:47.854656 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:47.854931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:47.855194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:47.866391 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:47.867835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac917e-dd2a-4119-bbe4-5b388db98383 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:47.878206 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1344/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:48.173078 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.174680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:48.187791 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4557-2380-459d-b132-1c4b52a78797 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.193160 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.194039 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.194719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.194719 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] PATH_INFO: `/v3/projects/0bebb3276a1d4568974adb76b9c20967` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.195929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bebb3276a1d4568974adb76b9c20967)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.197848 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.245025 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bebb3276a1d4568974adb76b9c20967', 'request_id': 'req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:48.250215 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bebb3276a1d4568974adb76b9c20967', 'request_id': 'req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:48.259657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bebb3276a1d4568974adb76b9c20967', 'request_id': 'req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:48.270596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] The token cache is being invalidate because project 0bebb3276a1d4568974adb76b9c20967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:48.270874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:48.271475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8e9f0e0b-3b2d-4b7c-9085-fc57592b9b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:48.273007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1363/2707] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:48 2022] DELETE /identity/v3/projects/0bebb3276a1d4568974adb76b9c20967 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:48.280434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.280957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.281066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.305274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:48.306521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:48.371030 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1345/2708] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:48.380584 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.380872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.381143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.402630 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:48.404382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:48.419119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1364/2709] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:48.423784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.434064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed5b8c-a788-4537-821b-500b85c0ca7d None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.440047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.440731 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.441011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.441282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.442015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:25:48.442357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.443980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.455704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1346/2710] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 20 16:25:48.460371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.469961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2f4a-0b1f-41b9-a249-59356d310e7f None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.475643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.476297 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.476573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.476849 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.477535 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.479491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.507176 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1365/2711] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:25:48 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:48.511437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.521282 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f387f-64d6-4b3d-8377-23555f5120ea admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.582877 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.583675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.584025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.584349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.585345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.588421 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.610470 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1347/2712] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:25:48 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:25:48.614765 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.625248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed7e4-89c9-4eae-aaed-d87b8cc82acc admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.630980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.631670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.631971 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.632236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.632984 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.634801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.645675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1366/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:48.649645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.660019 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ce26-6496-49e5-beba-e121b8d23369 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.665962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.666685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.666959 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.667226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.667947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.669569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23b283-3c2c-49d0-b3ab-b6fa5a0a7b4c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.681286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1348/2714] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:25:48.686529 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.698018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94850ec-8438-4947-8a80-589ef828b068 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.703981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.704889 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.705168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.705442 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] PATH_INFO: `/v3/projects/47e872ed912140e7aa65aab862566a30/users/a7310f15c2cf43ae83375be419dadc6e/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.721555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e872ed912140e7aa65aab862566a30, user_id=a7310f15c2cf43ae83375be419dadc6e, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.724263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.740116 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1367/2715] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:25:48 2022] PUT /identity/v3/projects/47e872ed912140e7aa65aab862566a30/users/a7310f15c2cf43ae83375be419dadc6e/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:48.751125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241435eb-532a-437d-994f-8e387909438a None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.751364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241435eb-532a-437d-994f-8e387909438a None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.751634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241435eb-532a-437d-994f-8e387909438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.779975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-241435eb-532a-437d-994f-8e387909438a None None] MFA Rules not processed for user `a7310f15c2cf43ae83375be419dadc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:48.781173 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-241435eb-532a-437d-994f-8e387909438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:48.847112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1349/2716] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:48.863608 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:48.866710 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:48.930844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913570-191f-49ca-9a8d-4b0019202f75 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:48.935853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:48.936505 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:48.936785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:48.937055 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:48.946401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:48.947823 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90d3b4-1c34-4bf9-849b-dff255bb83a7 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:48.957113 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1368/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:58.836625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241435eb-532a-437d-994f-8e387909438a None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:58.901306 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241435eb-532a-437d-994f-8e387909438a None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:58.906915 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:58.907814 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:58.908090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:58.908350 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] PATH_INFO: `/v3/users/a7310f15c2cf43ae83375be419dadc6e` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:58.909755 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7310f15c2cf43ae83375be419dadc6e)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:58.911834 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:58.966657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7310f15c2cf43ae83375be419dadc6e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:58.975014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7310f15c2cf43ae83375be419dadc6e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:58.975847 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7310f15c2cf43ae83375be419dadc6e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:58.984718 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7310f15c2cf43ae83375be419dadc6e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:58.996905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7310f15c2cf43ae83375be419dadc6e'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.003387 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1350/2718] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:25:58 2022] DELETE /identity/v3/users/a7310f15c2cf43ae83375be419dadc6e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:25:59.008407 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:59.008963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:59.008963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:59.027172 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:25:59.028419 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:59.087416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1369/2719] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:25:59.097637 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:59.099218 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:59.157321 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cc7c-cbe4-40a1-9afa-3eaa3a5707df admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:59.161146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:59.161790 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:59.162071 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:59.162380 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:59.172323 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:59.173750 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:59.183488 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1351/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:25:59.463827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:25:59.465391 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:25:59.483285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc3f36-c10a-4158-8cb2-68f395828d50 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:25:59.488578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:25:59.489704 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:25:59.489952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:25:59.491208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] PATH_INFO: `/v3/projects/47e872ed912140e7aa65aab862566a30` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:25:59.492606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e872ed912140e7aa65aab862566a30)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:25:59.494556 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:25:59.542224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e872ed912140e7aa65aab862566a30', 'request_id': 'req-cd9c544c-7b2a-4dfe-98d4-166165448aec'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.547918 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e872ed912140e7aa65aab862566a30', 'request_id': 'req-cd9c544c-7b2a-4dfe-98d4-166165448aec'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.556227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e872ed912140e7aa65aab862566a30', 'request_id': 'req-cd9c544c-7b2a-4dfe-98d4-166165448aec'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.567491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] The token cache is being invalidate because project 47e872ed912140e7aa65aab862566a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:25:59.567777 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.568489 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:25:59.570115 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1370/2721] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:25:59 2022] DELETE /identity/v3/projects/47e872ed912140e7aa65aab862566a30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:01.467469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:01.469142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:01.480298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af186-43f2-4234-971c-c1285b94991d service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:01.529228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:01.529867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:01.530161 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:01.530464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:01.532559 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:01.606985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:01.609297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:01.624026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1352/2722] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:26:08.249493 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:08.260064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:08.273641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c544c-7b2a-4dfe-98d4-166165448aec admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:08.278011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:08.278924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:08.279227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:08.279499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] PATH_INFO: `/v3/users/6b8e5fa032c5450bab0b54a7be0c046c` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:08.280653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8e5fa032c5450bab0b54a7be0c046c)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:08.282596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:08.337778 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8e5fa032c5450bab0b54a7be0c046c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.346592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8e5fa032c5450bab0b54a7be0c046c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.347240 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8e5fa032c5450bab0b54a7be0c046c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.347931 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8e5fa032c5450bab0b54a7be0c046c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.360095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8e5fa032c5450bab0b54a7be0c046c'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.372658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1371/2723] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:26:08 2022] DELETE /identity/v3/users/6b8e5fa032c5450bab0b54a7be0c046c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:08.547120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:08.559553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443d3-1159-455b-afe5-2c88c3e9bc73 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:08.618874 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:08.619779 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:08.620062 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:08.620332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] PATH_INFO: `/v3/projects/17cc716774984a15b9d00eb21651b3ee` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:08.621618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17cc716774984a15b9d00eb21651b3ee)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:08.623625 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:08.668754 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17cc716774984a15b9d00eb21651b3ee', 'request_id': 'req-4dc0bb5c-b4c6-4386-9891-994c850c3059'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.674636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17cc716774984a15b9d00eb21651b3ee', 'request_id': 'req-4dc0bb5c-b4c6-4386-9891-994c850c3059'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.679829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17cc716774984a15b9d00eb21651b3ee', 'request_id': 'req-4dc0bb5c-b4c6-4386-9891-994c850c3059'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.694064 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] The token cache is being invalidate because project 17cc716774984a15b9d00eb21651b3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:26:08.694389 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.695011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.696600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1353/2724] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:26:08 2022] DELETE /identity/v3/projects/17cc716774984a15b9d00eb21651b3ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:08.700878 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:08.702344 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:08.716117 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78912-c5cc-4dea-a4cd-5c83fdd16b23 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:08.779184 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:08.780462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:08.780743 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:08.780990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] PATH_INFO: `/v3/users/829b23b18ee849078534374e07f6e1d1` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:08.783088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829b23b18ee849078534374e07f6e1d1)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:08.786158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:08.834930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829b23b18ee849078534374e07f6e1d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.843567 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829b23b18ee849078534374e07f6e1d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.844236 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829b23b18ee849078534374e07f6e1d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.844996 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829b23b18ee849078534374e07f6e1d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.857051 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-41ec40aa-3782-4b99-a6ad-0dd354b3da76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829b23b18ee849078534374e07f6e1d1'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:08.870043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1372/2725] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:26:08 2022] DELETE /identity/v3/users/829b23b18ee849078534374e07f6e1d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:26:09.041017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.042619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:09.056791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0bb5c-b4c6-4386-9891-994c850c3059 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.112377 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.113180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.113471 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.113730 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] PATH_INFO: `/v3/projects/35b67da8df2646d082a9de338e7c1ddd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.114930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b67da8df2646d082a9de338e7c1ddd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.116891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.164673 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b67da8df2646d082a9de338e7c1ddd', 'request_id': 'req-f96ccc1c-55bb-46ee-a293-05d70db109c6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:09.170890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b67da8df2646d082a9de338e7c1ddd', 'request_id': 'req-f96ccc1c-55bb-46ee-a293-05d70db109c6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:09.176802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b67da8df2646d082a9de338e7c1ddd', 'request_id': 'req-f96ccc1c-55bb-46ee-a293-05d70db109c6'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:09.191824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] The token cache is being invalidate because project 35b67da8df2646d082a9de338e7c1ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:26:09.192107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:09.192773 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-f96ccc1c-55bb-46ee-a293-05d70db109c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:26:09.194469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1354/2726] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:26:09 2022] DELETE /identity/v3/projects/35b67da8df2646d082a9de338e7c1ddd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:09.200464 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.200772 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.201043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.220062 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:09.221254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:09.282192 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1373/2727] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:26:09.290581 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.290869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.291178 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.310489 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:09.311693 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:09.320102 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1355/2728] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:09.324360 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.334018 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0cbb5-9bc3-4368-8308-fefc9bdf9548 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.340614 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.341532 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.341907 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.342242 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.343401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:26:09.343834 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.346315 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.363073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1374/2729] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:26:09.367478 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.377519 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ee0e1-66a7-4ae9-b140-deead02b0d5f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.384146 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.385050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.385358 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.385757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.386840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.389801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.421636 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1356/2730] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:26:09 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:26:09.426072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.436333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112af0-e35f-4575-93e8-291dd81a2257 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.494479 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.495157 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.495439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.495713 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.496402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.498348 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.520447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1375/2731] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:26:09 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:26:09.525198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.535988 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7a4a-cbf3-477a-b812-ea51462ceb4c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.541220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.541891 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.542162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.542465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.543193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.544789 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.556155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1357/2732] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:26:09.560104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.570162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eda4c-2035-4544-99a1-a312c535c254 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.575290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.575937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.576246 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.576521 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.577278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.578895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56e365-9221-4cb6-8b41-53e51bd57f41 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.588903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1376/2733] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:26:09.593136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.603236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7340f-4c24-429f-aa3e-7add50786549 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.608074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.608944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.609221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.609491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] PATH_INFO: `/v3/projects/418f04c79658426bb30906d8f9da01ec/users/680e952402064e01bd046039bc6f33e3/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.624090 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418f04c79658426bb30906d8f9da01ec, user_id=680e952402064e01bd046039bc6f33e3, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.626982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.642363 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1358/2734] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:26:09 2022] PUT /identity/v3/projects/418f04c79658426bb30906d8f9da01ec/users/680e952402064e01bd046039bc6f33e3/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:09.647495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5302-b1a3-4fb9-9b16-2781e47bea1d None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.647785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5302-b1a3-4fb9-9b16-2781e47bea1d None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.648061 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5302-b1a3-4fb9-9b16-2781e47bea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.666576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2c5c5302-b1a3-4fb9-9b16-2781e47bea1d None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:09.667755 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2c5c5302-b1a3-4fb9-9b16-2781e47bea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:09.724677 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1377/2735] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:09.734536 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:09.736600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:09.794764 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f2ab-4cf5-40b3-a9fc-278c9088e007 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:09.798832 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:09.799457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:09.799734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:09.800002 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:09.809484 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:09.810947 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:09.820283 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1359/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:26:13.528799 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.529308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.529397 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.556904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] MFA Rules not processed for user `680e952402064e01bd046039bc6f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:13.558022 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:13.626639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1378/2737] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:13.630917 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.644251 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d5a5f-350d-46df-a035-d04ac07953e2 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:13.649355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:13.650001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.650316 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.650829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.652631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:13.654476 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:13.680955 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1360/2738] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:26:13 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:26:13.684904 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.697599 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450fa68-0e68-4843-8c49-654e2837a301 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:13.753265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:13.754020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.754327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.755400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.755400 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:13.757457 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:13.780174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1379/2739] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:26:13 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 20 16:26:13.784208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.797845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42403-298c-41f4-bbd5-d8b118e41a66 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:13.805010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:13.806015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.806430 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.806930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.810740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:13.810740 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:13.827591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1361/2740] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:26:13.831800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.842612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96daffb-0ef3-4563-936c-7b987d8d5f40 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:13.847635 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:13.849171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.849171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.849171 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] PATH_INFO: `/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73/users/5d0f02c9f4db4885bbe6f01a628fabed/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.866410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367002c1dd8e4ea0b36ef0bb007d7b73, user_id=5d0f02c9f4db4885bbe6f01a628fabed, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:13.869114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:13.884808 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1380/2741] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:26:13 2022] PUT /identity/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73/users/5d0f02c9f4db4885bbe6f01a628fabed/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:13.888776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.899104 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccd6c1-ece5-41b2-a009-da27ffb751ba admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:13.957916 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:13.958707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:13.958992 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:13.959274 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:13.960926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:13.961707 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:13.977756 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1362/2742] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:26:13.978656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:13.998227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97cacb-64f2-4473-a799-97db374ab126 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:14.003299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:14.004207 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:14.004611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:14.004893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] PATH_INFO: `/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73/users/5d0f02c9f4db4885bbe6f01a628fabed/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:14.006969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=367002c1dd8e4ea0b36ef0bb007d7b73, user_id=5d0f02c9f4db4885bbe6f01a628fabed, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:14.009616 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07259bd4-f43a-440a-897d-d09daed0751e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:14.020384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1381/2743] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:26:13 2022] PUT /identity/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73/users/5d0f02c9f4db4885bbe6f01a628fabed/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:26:17.565075 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:17.567345 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:17.698355 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f788d-3687-4790-921a-33d53e172956 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:17.791280 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:17.792147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:17.792431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:17.792711 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:17.796913 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:17.815204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:17.821900 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:17.837543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1363/2744] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:26:20.310404 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c1e8c-6f1f-475a-a42f-f437d3a131d2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:20.310913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c1e8c-6f1f-475a-a42f-f437d3a131d2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:20.311013 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c1e8c-6f1f-475a-a42f-f437d3a131d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:20.343027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-be8c1e8c-6f1f-475a-a42f-f437d3a131d2 None None] MFA Rules not processed for user `5d0f02c9f4db4885bbe6f01a628fabed`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:20.344498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-be8c1e8c-6f1f-475a-a42f-f437d3a131d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:20.417868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1382/2745] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:20.424824 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:20.426541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:20.503645 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de386f46-a230-440d-ac9e-712134fe1ecf service placement] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:20.509017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:20.509658 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:20.509933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:20.510203 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:20.563364 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:20.564948 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fb03-d60b-41ed-9542-0ac2b46e5ead service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:20.573930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1364/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:26:27.827752 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:27.828278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:27.828278 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:27.846461 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] MFA Rules not processed for user `677f2ea9fdab4d24800b9cd386491c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:27.847646 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:27.905558 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1383/2747] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:36.955293 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c12-34c9-4c09-9747-a895966da3c1 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:36.955863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c12-34c9-4c09-9747-a895966da3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:36.955863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8c12-34c9-4c09-9747-a895966da3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:36.974417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-3aad8c12-34c9-4c09-9747-a895966da3c1 None None] MFA Rules not processed for user `680e952402064e01bd046039bc6f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:26:36.975784 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3aad8c12-34c9-4c09-9747-a895966da3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:26:36.983422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1365/2748] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:26:53.410043 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:26:53.466456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f1c8-a6cb-4cde-8633-88e561c9ccc4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:26:53.470408 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:26:53.471050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:26:53.471325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:26:53.471591 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:26:53.480864 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:26:53.482286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:26:53.491611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1384/2749] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:27:32.418651 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:27:32.419239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:27:32.419239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:27:32.436898 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] MFA Rules not processed for user `677f2ea9fdab4d24800b9cd386491c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:27:32.438076 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:27:32.445429 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1366/2750] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:15.371237 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:15.373243 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:15.441639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2727-c89d-419c-a456-0f8b15eca557 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:15.447339 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:15.448047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:15.448326 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:15.448596 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:15.450618 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:15.465930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:15.467318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:15.478289 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1385/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:23.415158 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:23.416791 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:23.429926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe485ee-7c4d-4ae9-8967-c27a8c2adf6e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:23.434120 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:23.434876 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:23.435122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:23.435382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:23.437211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:23.451619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:23.453050 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:23.464393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1367/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:36.289694 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:36.291320 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:36.367623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545d5c-72b0-46df-b3ac-33048c2db35a service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:36.373520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:36.374940 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.375253 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.375566 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] PATH_INFO: `/v3/users/677f2ea9fdab4d24800b9cd386491c11` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.377021 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677f2ea9fdab4d24800b9cd386491c11)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:36.379480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:36.432510 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677f2ea9fdab4d24800b9cd386491c11'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.441019 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677f2ea9fdab4d24800b9cd386491c11'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.441658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677f2ea9fdab4d24800b9cd386491c11'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.442338 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677f2ea9fdab4d24800b9cd386491c11'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.453726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4bf624c7-f2e2-40b3-9a78-c11dbfb6fe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677f2ea9fdab4d24800b9cd386491c11'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.466715 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1386/2753] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:28:36 2022] DELETE /identity/v3/users/677f2ea9fdab4d24800b9cd386491c11 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:36.644553 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:36.656001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4db0a-61d2-4921-8b1e-56b43e9a88a4 service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:36.715445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:36.716327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.716600 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.716956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] PATH_INFO: `/v3/projects/e4fa2d82e12e4804aa63d46684334f71` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.718144 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fa2d82e12e4804aa63d46684334f71)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:36.720106 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:36.766400 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fa2d82e12e4804aa63d46684334f71', 'request_id': 'req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.772472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fa2d82e12e4804aa63d46684334f71', 'request_id': 'req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.778202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fa2d82e12e4804aa63d46684334f71', 'request_id': 'req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.792107 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] The token cache is being invalidate because project e4fa2d82e12e4804aa63d46684334f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:28:36.792392 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.793018 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-0b02fb55-680d-4fb3-a4ee-08c18144e2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:36.794611 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1368/2754] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:28:36 2022] DELETE /identity/v3/projects/e4fa2d82e12e4804aa63d46684334f71 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:36.799844 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.800132 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.800420 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.820384 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:36.821601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:36.884216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1387/2755] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:36.896217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.896509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.896788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.917889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:36.919096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:36.927780 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1369/2756] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:36.932392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:36.942875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf84d-916f-4a88-99fc-827d5e3a328a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:36.948856 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:36.949511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.949788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.950057 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.950822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:28:36.951152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:36.952785 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:36.964924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1388/2757] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:28:36.969884 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:36.979606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26d057-4805-4dc6-b63b-472e40c4ff04 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:36.985659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:36.986379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:36.986650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:36.986903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:36.987584 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:36.989511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.020982 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1370/2758] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:28:36 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:37.025190 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.035197 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e7e-6f02-4f66-a871-17e8c89ba788 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.096845 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.097508 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.097788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.098058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.098769 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.100684 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.129460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1389/2759] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:28:37 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:37.135810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.147119 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb7fe-f993-469d-99aa-0505aa156198 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.152781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.153443 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.153725 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.153981 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.154767 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.156413 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.167193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1371/2760] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:37.171434 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.181921 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be7828-3f4f-4ce8-8184-6020b0d67998 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.187318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.187975 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.188254 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.188526 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.189232 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.190874 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83d598-c089-4a81-bf18-04c8a4f4103c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.201443 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1390/2761] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:28:37.205325 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.215802 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48dfde-c9ee-4488-969f-a41e88a5da16 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.221309 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.222197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.222500 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.222766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] PATH_INFO: `/v3/projects/69e7d10bb192428d8c2d516b084ebb08/users/a8634ddc806e4df2b50783448f4b406d/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.238209 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e7d10bb192428d8c2d516b084ebb08, user_id=a8634ddc806e4df2b50783448f4b406d, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.240894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.259410 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1372/2762] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:37 2022] PUT /identity/v3/projects/69e7d10bb192428d8c2d516b084ebb08/users/a8634ddc806e4df2b50783448f4b406d/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:37.269956 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.270263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.270554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.296673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] MFA Rules not processed for user `a8634ddc806e4df2b50783448f4b406d`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:37.297853 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:37.362042 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1391/2763] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:37.367008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.433936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e032-d61e-4c5c-8d14-1ea94f65b8cf admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.439502 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.440166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.440442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.440721 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.441420 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.443438 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.472346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1373/2764] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:28:37 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:37.476800 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.488119 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960f7b-6dfc-4676-80cd-2b81d3768a93 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.544589 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.545247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.545527 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.545842 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.546495 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.548401 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.573349 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1392/2765] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:28:37 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:37.577487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.587622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba91a-67a8-4939-8655-f7810be4073f admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.592162 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.592808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.593083 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.593352 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.594070 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.595685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.606386 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1374/2766] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:37.610102 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.620716 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4678f1-b36d-40b7-965c-3e4ed815b80c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.626299 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.627503 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.627784 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.628050 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] PATH_INFO: `/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.643744 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9510d96f4ecd42a3b9a73d619c82c33d, user_id=f0f7c1a6b1ca4863bcc452fb8f7e6ceb, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.646410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.662487 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1393/2767] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:37 2022] PUT /identity/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:37.666512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.676893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce562f-608f-4fdb-b002-ac62b253211c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.742140 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.742886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.743160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.743449 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.744571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.747066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fd7a-15d4-4096-b4c1-6472aa7a47f0 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.762766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1375/2768] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 20 16:28:37.767709 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.778969 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac768-3f21-4897-a010-91fed6a11557 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.785393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.786284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.786610 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.786890 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] PATH_INFO: `/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.789234 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9510d96f4ecd42a3b9a73d619c82c33d, user_id=f0f7c1a6b1ca4863bcc452fb8f7e6ceb, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:37.791964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:37.803832 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1394/2769] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:37 2022] PUT /identity/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:37.821586 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.821957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.822226 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:37.850903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] MFA Rules not processed for user `f0f7c1a6b1ca4863bcc452fb8f7e6ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:37.852101 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:37.918879 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1376/2770] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:37.929714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:37.931512 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:37.987114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134703-ddc3-4eb0-8359-8fa6ed87416e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:37.991263 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:37.991888 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:37.992229 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:37.992438 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.002001 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:38.003796 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ba62-5b86-464e-8deb-7015386d95b3 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:38.013302 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1395/2771] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:38.159543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:38.224852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53f6c-dc9b-4a12-9818-6014e73e7783 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:38.230690 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:38.231593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:38.231885 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:38.232136 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] PATH_INFO: `/v3/users/a8634ddc806e4df2b50783448f4b406d` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.233480 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8634ddc806e4df2b50783448f4b406d)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:38.235460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:38.285591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8634ddc806e4df2b50783448f4b406d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.292288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8634ddc806e4df2b50783448f4b406d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.292957 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8634ddc806e4df2b50783448f4b406d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.301967 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8634ddc806e4df2b50783448f4b406d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.313785 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8634ddc806e4df2b50783448f4b406d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.319890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1377/2772] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:28:38 2022] DELETE /identity/v3/users/a8634ddc806e4df2b50783448f4b406d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:38.325542 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:38.326058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:38.326163 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.349367 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:38.350577 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:38.413576 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1396/2773] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:38.423618 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:38.425205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:38.483370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7561ea-75bf-4f2c-ac7b-50621b1e43ca admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:38.487966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:38.488606 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:38.488883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:38.489180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.499042 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:38.500467 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:38.510460 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1378/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:38.784813 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:38.786248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:38.798634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadf13-a4a4-4698-8c85-8850b1d3f108 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:38.803491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:38.804334 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:38.804705 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:38.804982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] PATH_INFO: `/v3/projects/69e7d10bb192428d8c2d516b084ebb08` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.806162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e7d10bb192428d8c2d516b084ebb08)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:38.808100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:38.855623 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e7d10bb192428d8c2d516b084ebb08', 'request_id': 'req-9c014075-d787-4f59-856e-d0d0216c905e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.861387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e7d10bb192428d8c2d516b084ebb08', 'request_id': 'req-9c014075-d787-4f59-856e-d0d0216c905e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.870675 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e7d10bb192428d8c2d516b084ebb08', 'request_id': 'req-9c014075-d787-4f59-856e-d0d0216c905e'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.882158 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] The token cache is being invalidate because project 69e7d10bb192428d8c2d516b084ebb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:28:38.882475 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.883200 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:38.884827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1397/2775] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:28:38 2022] DELETE /identity/v3/projects/69e7d10bb192428d8c2d516b084ebb08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:38.889014 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:38.898907 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d52b5-c8cf-46fa-bc70-fbebde38bf44 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:38.957845 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:38.958827 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:38.959105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:38.959374 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] PATH_INFO: `/v3/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:38.960607 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f7c1a6b1ca4863bcc452fb8f7e6ceb)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:38.962552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.013370 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f7c1a6b1ca4863bcc452fb8f7e6ceb'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.020598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f7c1a6b1ca4863bcc452fb8f7e6ceb'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.021285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f7c1a6b1ca4863bcc452fb8f7e6ceb'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.029670 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f7c1a6b1ca4863bcc452fb8f7e6ceb'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.041340 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b5bd2226-59de-4345-83c9-0f75b1f71aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f7c1a6b1ca4863bcc452fb8f7e6ceb'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.047204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1379/2776] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:28:38 2022] DELETE /identity/v3/users/f0f7c1a6b1ca4863bcc452fb8f7e6ceb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:39.325523 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.327486 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:39.342162 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c014075-d787-4f59-856e-d0d0216c905e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.400459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.401639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.402024 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.402309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] PATH_INFO: `/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.404044 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9510d96f4ecd42a3b9a73d619c82c33d)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.407150 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.470056 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9510d96f4ecd42a3b9a73d619c82c33d', 'request_id': 'req-bd5a4d23-3f51-434f-8da9-6a91accee507'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.479091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9510d96f4ecd42a3b9a73d619c82c33d', 'request_id': 'req-bd5a4d23-3f51-434f-8da9-6a91accee507'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.488571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9510d96f4ecd42a3b9a73d619c82c33d', 'request_id': 'req-bd5a4d23-3f51-434f-8da9-6a91accee507'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.499351 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] The token cache is being invalidate because project 9510d96f4ecd42a3b9a73d619c82c33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:28:39.499631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.500335 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-bd5a4d23-3f51-434f-8da9-6a91accee507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:39.501964 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1398/2777] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:28:39 2022] DELETE /identity/v3/projects/9510d96f4ecd42a3b9a73d619c82c33d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:39.507408 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a974c-5405-48ad-951b-5076898b992f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.507696 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a974c-5405-48ad-951b-5076898b992f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.507973 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a974c-5405-48ad-951b-5076898b992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.525520 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c41a974c-5405-48ad-951b-5076898b992f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:39.526782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c41a974c-5405-48ad-951b-5076898b992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:39.586066 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1380/2778] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:39.596294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.596575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.596843 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.616961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:39.618147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:39.628807 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1399/2779] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:39.632909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a974c-5405-48ad-951b-5076898b992f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.642709 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a974c-5405-48ad-951b-5076898b992f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.647506 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.648155 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.648432 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.648703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.649427 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:28:39.649728 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.651434 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.662686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1381/2780] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:28:39.667492 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.681951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a7c4-7f32-4192-a595-e0d80e8311e7 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.690905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.691804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.692083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.692353 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.693210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.696248 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.732201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1400/2781] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:28:39 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:39.736423 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.746211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bde3c-7f87-4827-926f-9781b7fa6b8b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.800838 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.801510 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.801788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.802060 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.802782 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.804698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.827103 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1382/2782] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:28:39 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:39.831312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.841437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c31e-85ac-4159-8399-fe03926372d0 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.846484 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.847136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.847414 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.847708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.848426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.850060 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.860371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1401/2783] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:39.864205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.875623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c40c0-cc32-471d-a140-9710220da10c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.881577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.882278 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.882562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.882833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.883583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.885200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402b889-7ce8-4e68-afe7-ce261a7117ff admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.895778 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1383/2784] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:39.900201 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:39.910114 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270880-0761-45fb-bd9e-f683a15008f7 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:39.914794 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:39.915670 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.915948 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.916210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] PATH_INFO: `/v3/projects/679f6bf86e3d4ac2a1edc22f41de1fb6/users/24e4e9e6749940e7b86556fdebf92743/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.930247 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679f6bf86e3d4ac2a1edc22f41de1fb6, user_id=24e4e9e6749940e7b86556fdebf92743, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:39.932917 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:39.952821 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1402/2785] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:39 2022] PUT /identity/v3/projects/679f6bf86e3d4ac2a1edc22f41de1fb6/users/24e4e9e6749940e7b86556fdebf92743/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:28:39.964424 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:39.964708 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:39.964999 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:39.993189 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] MFA Rules not processed for user `24e4e9e6749940e7b86556fdebf92743`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:39.994411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:40.059469 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1384/2786] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:40.064632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.131195 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526acc2-57ec-46f0-b870-5bf17247e9d8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.136776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.137426 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.137700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.137966 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.138724 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.140641 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.170482 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1403/2787] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:28:40 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:40.174543 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.184980 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1dc4a-71ee-4dea-a9b3-c0dc1f6812af None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.252000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.253020 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.253328 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.253575 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.254291 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.256228 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.284801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1385/2788] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:28:40 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:40.290631 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.301455 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f5b55-c311-460c-9d87-a127e645658a admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.306628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.307309 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.307573 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.307839 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.308578 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.310174 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.320665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1404/2789] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:40.324901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.335324 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155ff2-4ce8-420e-8ff5-0829686c13f6 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.340978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.341905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.342347 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.342623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] PATH_INFO: `/v3/projects/8138e83898ac4b9d89fd457e892f96b1/users/7830d2c828154713b9f29dd19229435a/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.358833 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8138e83898ac4b9d89fd457e892f96b1, user_id=7830d2c828154713b9f29dd19229435a, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.361473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.378936 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1386/2790] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:40 2022] PUT /identity/v3/projects/8138e83898ac4b9d89fd457e892f96b1/users/7830d2c828154713b9f29dd19229435a/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:40.383030 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.393285 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c992e-b53c-460c-975e-f10006168219 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.449458 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.450036 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.450298 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.450609 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.451355 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.452953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db141e2e-63a6-4cc5-92c4-70da43792560 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.462706 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1405/2791] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:40.467601 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.481263 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afe8c-9376-4d2c-b73c-5245b32ce2b8 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.489417 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.490807 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.491182 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.491541 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] PATH_INFO: `/v3/projects/8138e83898ac4b9d89fd457e892f96b1/users/7830d2c828154713b9f29dd19229435a/roles/48d62f7e510942b2a76f34ddf04cd808` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.494815 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8138e83898ac4b9d89fd457e892f96b1, user_id=7830d2c828154713b9f29dd19229435a, role_id=48d62f7e510942b2a76f34ddf04cd808)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.498966 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.510127 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1387/2792] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:40 2022] PUT /identity/v3/projects/8138e83898ac4b9d89fd457e892f96b1/users/7830d2c828154713b9f29dd19229435a/roles/48d62f7e510942b2a76f34ddf04cd808 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:40.521549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.521835 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.522106 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.548980 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] MFA Rules not processed for user `7830d2c828154713b9f29dd19229435a`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:40.550177 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:40.630488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1406/2793] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:40.642082 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.644010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:40.700180 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a612-4503-4575-9f9c-09cc9fc94b2c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.704262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.704889 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.705166 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.705445 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.716703 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.719000 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f392a3-168f-4c43-9151-8050921d7de0 service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.734239 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1388/2794] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:40.815929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:40.825643 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c541f9-daf3-4722-ad49-83fa17cd7bc2 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:40.829377 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:40.830076 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:40.830382 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:40.830653 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:40.890083 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:40.891549 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:40.900625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1407/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:55.561974 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c4f4-3c3e-4f31-a565-64b80dd0fb97 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:55.562547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c4f4-3c3e-4f31-a565-64b80dd0fb97 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:55.562547 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c4f4-3c3e-4f31-a565-64b80dd0fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:55.581852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-0ef0c4f4-3c3e-4f31-a565-64b80dd0fb97 None None] MFA Rules not processed for user `680e952402064e01bd046039bc6f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:55.583099 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-0ef0c4f4-3c3e-4f31-a565-64b80dd0fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:55.638996 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1389/2796] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:55.964696 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:56.025168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753bbc-8456-4a1e-b763-7af7d10cbeab service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:56.029762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:56.030672 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:56.030953 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:56.031220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] PATH_INFO: `/v3/users/24e4e9e6749940e7b86556fdebf92743` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:56.032413 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e4e9e6749940e7b86556fdebf92743)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:56.034410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:56.080915 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e4e9e6749940e7b86556fdebf92743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.089058 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e4e9e6749940e7b86556fdebf92743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.089811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e4e9e6749940e7b86556fdebf92743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.090718 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e4e9e6749940e7b86556fdebf92743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.103125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e4e9e6749940e7b86556fdebf92743'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.115059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1408/2797] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:28:55 2022] DELETE /identity/v3/users/24e4e9e6749940e7b86556fdebf92743 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:56.119975 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:56.120454 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:56.120667 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:56.138829 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:56.140046 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:56.197354 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1390/2798] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:56.208993 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:56.210548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:56.268188 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897071-5619-4408-a3db-b417564c7605 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:56.272433 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:56.273136 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:56.273370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:56.273665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:56.282865 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:56.284435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:56.293811 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1409/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:56.599985 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:56.601644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:56.620393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6494c28-0bdc-4d47-aa29-462c4a4f26bd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:56.626160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:56.626963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:56.627237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:56.628022 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] PATH_INFO: `/v3/projects/679f6bf86e3d4ac2a1edc22f41de1fb6` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:56.629349 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679f6bf86e3d4ac2a1edc22f41de1fb6)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:56.631369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:56.681108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679f6bf86e3d4ac2a1edc22f41de1fb6', 'request_id': 'req-2b1ae33c-7b29-48f1-aa29-57f2f3218581'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.687515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679f6bf86e3d4ac2a1edc22f41de1fb6', 'request_id': 'req-2b1ae33c-7b29-48f1-aa29-57f2f3218581'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.693320 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679f6bf86e3d4ac2a1edc22f41de1fb6', 'request_id': 'req-2b1ae33c-7b29-48f1-aa29-57f2f3218581'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.708177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] The token cache is being invalidate because project 679f6bf86e3d4ac2a1edc22f41de1fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:28:56.708451 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.709054 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.710638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1391/2800] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:28:56 2022] DELETE /identity/v3/projects/679f6bf86e3d4ac2a1edc22f41de1fb6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:56.714741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:56.723986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37173-0c9f-47e8-b413-a0053412bfc2 service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:56.778854 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:56.779746 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:56.780020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:56.780288 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] PATH_INFO: `/v3/users/7830d2c828154713b9f29dd19229435a` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:56.781452 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] RBAC: Authorizing `identity:delete_user(user_id=7830d2c828154713b9f29dd19229435a)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:56.783402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:56.829531 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7830d2c828154713b9f29dd19229435a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.837804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7830d2c828154713b9f29dd19229435a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.838422 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7830d2c828154713b9f29dd19229435a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.839059 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7830d2c828154713b9f29dd19229435a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.850761 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-4168f8ff-30d1-4dc3-916c-3f2b084acced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7830d2c828154713b9f29dd19229435a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:56.863546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1410/2801] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:28:56 2022] DELETE /identity/v3/users/7830d2c828154713b9f29dd19229435a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:28:57.139818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.141295 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:57.158047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae33c-7b29-48f1-aa29-57f2f3218581 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.216623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.217515 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.217793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.218051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] PATH_INFO: `/v3/projects/8138e83898ac4b9d89fd457e892f96b1` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.219286 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8138e83898ac4b9d89fd457e892f96b1)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.221190 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.268995 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8138e83898ac4b9d89fd457e892f96b1', 'request_id': 'req-eb9292da-8d60-4018-948e-5f3ffd27ddf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:57.275333 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8138e83898ac4b9d89fd457e892f96b1', 'request_id': 'req-eb9292da-8d60-4018-948e-5f3ffd27ddf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:57.281743 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8138e83898ac4b9d89fd457e892f96b1', 'request_id': 'req-eb9292da-8d60-4018-948e-5f3ffd27ddf4'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:57.296088 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] The token cache is being invalidate because project 8138e83898ac4b9d89fd457e892f96b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:28:57.296464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:57.297069 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-eb9292da-8d60-4018-948e-5f3ffd27ddf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:28:57.298944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1392/2802] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:28:57 2022] DELETE /identity/v3/projects/8138e83898ac4b9d89fd457e892f96b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:57.303741 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.304233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.304354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.323011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:57.324208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:57.388079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1411/2803] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:57.397346 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.397633 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.397911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.416455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:57.417661 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:57.425930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1393/2804] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:28:57.430628 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.441328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2a77f-c5b1-4c20-8f7c-76b709b499ed None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.447933 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.448730 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.449007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.449271 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.450072 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:28:57.450560 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.452272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.466290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1412/2805] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:28:57.469039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.478558 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449792-6b4d-4691-ad97-8c170434cc9b None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.485148 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.485852 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.486133 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.486886 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.488649 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.490893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.520734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1394/2806] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:28:57 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:57.525185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.535585 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ba5d-8a89-4525-b054-d532c09a3361 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.592041 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.592734 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.592990 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.593260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.593943 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.595891 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.631926 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.638379 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1413/2807] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:28:57 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:28:57.643457 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb13c-b2f1-478a-bdd0-536b5f8b7006 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.648461 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.649145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.649431 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.649701 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.650564 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.652164 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.662715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1395/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:57.666774 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.676660 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a62861-e13b-4bef-a904-e31911bc1756 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.681392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.682152 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.682572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.682909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.683714 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.685372 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fd2d-c050-4265-995a-e83e42413e46 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.695504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1414/2809] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:28:57.699772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.710598 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af37b7f-2a80-4c26-baec-d5879109a387 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.715722 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.716675 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.716956 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.717229 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] PATH_INFO: `/v3/projects/8c672ac5f21341dd81fd7f6818154c73/users/e0ec43230b864ad282d36f39b4f3adfd/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.731583 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c672ac5f21341dd81fd7f6818154c73, user_id=e0ec43230b864ad282d36f39b4f3adfd, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.734237 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.749023 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1396/2810] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:28:57 2022] PUT /identity/v3/projects/8c672ac5f21341dd81fd7f6818154c73/users/e0ec43230b864ad282d36f39b4f3adfd/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:28:57.760930 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.761219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.761490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.789081 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] MFA Rules not processed for user `e0ec43230b864ad282d36f39b4f3adfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:28:57.790327 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:57.853792 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1415/2811] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:28:57.864894 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:57.866698 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:57.925147 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78282f-6c62-452f-83f8-8fe41b386579 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:57.929081 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:57.929737 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:57.930017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:57.930310 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:57.941077 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:57.942566 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:57.952585 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1397/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:28:58.201068 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:28:58.207462 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:58.274872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f964f61-9bc1-4b46-97b0-204aff89cfe9 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:28:58.279295 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:28:58.279963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:28:58.280257 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:28:58.280507 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:28:58.282593 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:28:58.293423 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:28:58.295260 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade14ba2-70fa-403e-8ab4-58eb2906aebc service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:28:58.304525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1416/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:05.613534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:05.683622 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8623a1-fe46-4294-aab9-d80ef29ce40b service cinder] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:05.689933 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:05.690869 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:05.691142 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:05.691406 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] PATH_INFO: `/v3/users/e0ec43230b864ad282d36f39b4f3adfd` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:05.692776 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ec43230b864ad282d36f39b4f3adfd)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:05.695032 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:05.744252 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ec43230b864ad282d36f39b4f3adfd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:05.752230 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ec43230b864ad282d36f39b4f3adfd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:05.753395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ec43230b864ad282d36f39b4f3adfd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:05.762160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ec43230b864ad282d36f39b4f3adfd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:05.774385 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ec43230b864ad282d36f39b4f3adfd'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:05.780398 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1398/2814] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:29:05 2022] DELETE /identity/v3/users/e0ec43230b864ad282d36f39b4f3adfd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:05.785121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:05.785538 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:05.785787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:05.803924 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:05.805128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:05.861935 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1417/2815] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:05.871666 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:05.873193 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:05.936808 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f06a-7bc0-473b-a844-3c4d0bc3b559 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:05.941227 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:05.941867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:05.942145 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:05.942442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:05.951472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:05.952895 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0a4f2-85da-4813-9ff4-951c4bc96870 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:05.962156 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1399/2816] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:06.229210 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.230606 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:06.243726 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa7c04-22bd-45a5-9ccc-10aab99401b4 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.248648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.249583 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.249868 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.250140 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] PATH_INFO: `/v3/projects/8c672ac5f21341dd81fd7f6818154c73` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.251336 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c672ac5f21341dd81fd7f6818154c73)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.253611 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.303273 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c672ac5f21341dd81fd7f6818154c73', 'request_id': 'req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:06.308648 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c672ac5f21341dd81fd7f6818154c73', 'request_id': 'req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:06.318580 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c672ac5f21341dd81fd7f6818154c73', 'request_id': 'req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:06.329708 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] The token cache is being invalidate because project 8c672ac5f21341dd81fd7f6818154c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:29:06.329988 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:06.330639 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-8dd9aa26-0c2f-4a25-bfde-a3816cda9ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:06.332222 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1418/2817] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:29:06 2022] DELETE /identity/v3/projects/8c672ac5f21341dd81fd7f6818154c73 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:06.337357 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.337664 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.337931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.355736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:06.356858 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:06.417138 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1400/2818] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:06.427892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.428219 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.428498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.447954 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:06.449147 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:06.457711 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1419/2819] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:06.461950 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.471941 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96784a-11da-4c6f-9f9b-20f12f4107dd None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.477674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.478359 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.478634 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.478905 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.479629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:29:06.479930 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.481539 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.493269 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1401/2820] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:29:06.497571 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.507601 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6f08-ab2b-41ca-8a66-8798d833646a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.512859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.513525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.513801 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.514070 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.514803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.516737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.544768 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1420/2821] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:06.549202 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.559031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20303-d210-4588-bef1-08ceb021e267 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.615746 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.616473 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.616691 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.616960 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.617650 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.619619 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.644419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1402/2822] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:29:06 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:06.645748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.656011 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79365d1-c852-4be6-a2e1-a8e7065510b8 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.661020 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.661693 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.661986 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.662416 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.663255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.664895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.675685 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1421/2823] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:06.680129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.690214 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99815-ecf4-4c58-bc4f-f1af21c91c01 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.695177 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.695818 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.696112 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.696383 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.697108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.698774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404f10-e9e6-45a4-bb0f-83c9df6e3c38 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.708628 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1403/2824] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:06.712919 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.723141 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891f12-e559-44ac-a669-5eaaea3ec373 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.728366 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.729272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.729546 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.729816 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] PATH_INFO: `/v3/projects/03c0c59171a04d518168faf22cfe180b/users/0cc2723f97a74f62aafc87bcf1efa617/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.744007 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c0c59171a04d518168faf22cfe180b, user_id=0cc2723f97a74f62aafc87bcf1efa617, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.746676 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.761100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1422/2825] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:29:06 2022] PUT /identity/v3/projects/03c0c59171a04d518168faf22cfe180b/users/0cc2723f97a74f62aafc87bcf1efa617/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:29:06.771805 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.772121 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.772395 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.800298 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] MFA Rules not processed for user `0cc2723f97a74f62aafc87bcf1efa617`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:06.801472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:06.865411 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1404/2826] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:06.877052 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:06.879340 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:06.935857 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa2e1-d667-4de9-9b90-40c7222ca4ba admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:06.939947 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:06.940619 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:06.940895 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:06.941165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:06.950872 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:06.952317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:06.961509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1423/2827] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:08.355937 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:08.358096 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:08.440787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05eeae-9e15-47d6-8726-18f0a108368e None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:08.447016 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:08.447686 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:08.447972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:08.448243 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:08.449998 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:08.462477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:08.464305 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa0389-87ad-46c7-9a9f-7230edc08338 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:08.476436 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1405/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:09.520270 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:09.584661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce464b-b379-4672-b8d0-4a751d695376 service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:09.589951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:09.591255 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:09.591581 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:09.591952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] PATH_INFO: `/v3/users/0cc2723f97a74f62aafc87bcf1efa617` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:09.594181 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc2723f97a74f62aafc87bcf1efa617)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:09.597241 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:09.652439 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc2723f97a74f62aafc87bcf1efa617'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:09.662429 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc2723f97a74f62aafc87bcf1efa617'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:09.663183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc2723f97a74f62aafc87bcf1efa617'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:09.663936 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc2723f97a74f62aafc87bcf1efa617'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:09.676460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc2723f97a74f62aafc87bcf1efa617'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:09.689272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1424/2829] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:29:09 2022] DELETE /identity/v3/users/0cc2723f97a74f62aafc87bcf1efa617 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:09.694222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:09.694781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:09.694781 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:09.713899 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:09.715382 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:09.780394 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1406/2830] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:09.791231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:09.792893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:09.854613 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981b9e-dd3b-4b96-8f90-4784ca99480f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:09.858810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:09.859459 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:09.859822 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:09.860161 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:09.870091 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:09.871701 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4686139-6351-441c-a2d6-5b35b6533f49 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:09.881636 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1425/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:10.142039 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.143689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:10.156373 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7538d1-0159-4536-8717-e2616b731709 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.161580 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.163186 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.163468 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.163744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] PATH_INFO: `/v3/projects/03c0c59171a04d518168faf22cfe180b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.165505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c0c59171a04d518168faf22cfe180b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.167571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.218356 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c0c59171a04d518168faf22cfe180b', 'request_id': 'req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:10.225194 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c0c59171a04d518168faf22cfe180b', 'request_id': 'req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:10.231801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c0c59171a04d518168faf22cfe180b', 'request_id': 'req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:10.246772 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] The token cache is being invalidate because project 03c0c59171a04d518168faf22cfe180b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:29:10.247051 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:10.247680 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-aca12875-22e2-4bff-bcf6-4d5c64d8ba01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:10.249231 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1407/2832] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:29:10 2022] DELETE /identity/v3/projects/03c0c59171a04d518168faf22cfe180b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:10.256249 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.256537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.256810 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.275396 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:10.276656 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:10.335206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1426/2833] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:10.342679 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.342963 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.343233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.361993 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:10.363297 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:10.372911 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1408/2834] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:10.377812 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.387602 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e485f-5fd3-4ab4-994d-f3c751eba535 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.392657 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.393365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.393634 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.393913 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.394877 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:29:10.395183 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.396781 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.408494 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1427/2835] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:29:10.413290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.423335 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb3ca-e925-4457-9406-ab06681b1150 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.428247 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.429113 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.429568 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.429931 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] PATH_INFO: `/v3/projects` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.431369 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.433341 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.459906 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1409/2836] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:29:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:10.464268 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.474386 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f082-11b6-479c-bd55-6d3e54b63e5d admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.531587 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.532402 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.532750 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.533087 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] PATH_INFO: `/v3/users` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.533846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.535882 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.557655 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1428/2837] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:29:10 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:10.561881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.572216 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5213b-e226-49f1-9e06-42978db06030 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.577049 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.577712 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.577994 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.578288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.579025 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.580623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.591332 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1410/2838] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:10.595541 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.605331 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dc15-7ce0-412d-aa42-50630a431b0f admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.610125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.610818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.611097 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.611371 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.612100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.613846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ac53-6023-45b4-800c-38ab90cc902b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.624227 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1429/2839] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:10.628864 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.639183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daafcd-c890-494e-94ce-e867ca8ba821 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.644255 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.645150 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] REQUEST_METHOD: `PUT` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.645442 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.645697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] PATH_INFO: `/v3/projects/346b515a7de94c959094673e350f9518/users/2acaeb5519174df1b01e37dca9b5f60d/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.660505 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=346b515a7de94c959094673e350f9518, user_id=2acaeb5519174df1b01e37dca9b5f60d, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.663159 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.677868 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1411/2840] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:29:10 2022] PUT /identity/v3/projects/346b515a7de94c959094673e350f9518/users/2acaeb5519174df1b01e37dca9b5f60d/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 20 16:29:10.688363 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.688658 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.688934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.716065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] MFA Rules not processed for user `2acaeb5519174df1b01e37dca9b5f60d`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:10.717252 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:10.779498 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1430/2841] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:10.791527 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:10.793376 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:10.873689 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6932e9-8286-4e11-b8bb-5ad72b9ea21b admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:10.878716 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee72038f64224b14bad9e63568c3e316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:10.879393 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:10.879697 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:10.879965 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:10.889688 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:10.891208 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:10.902883 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1412/2842] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:12.749139 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:12.750830 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:12.836559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c439-39cd-4fde-bf2d-57f6e9ed689a None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:12.843125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:12.843827 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:12.844105 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:12.844410 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:12.846972 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:12.859748 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:12.861322 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bab99-432f-4cb9-a348-bfaae618b85c service nova] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:12.872185 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1431/2843] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:35.582521 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:35.648976 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270af9-b501-4bfb-81c2-83f9673ce896 service glance] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:35.655130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11357f5-4538-4567-af89-34156988230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:35.656026 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11357f5-4538-4567-af89-34156988230d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:35.656302 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11357f5-4538-4567-af89-34156988230d admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:35.656549 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11357f5-4538-4567-af89-34156988230d admin admin] PATH_INFO: `/v3/users/2acaeb5519174df1b01e37dca9b5f60d` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:35.657922 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11357f5-4538-4567-af89-34156988230d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acaeb5519174df1b01e37dca9b5f60d)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:35.659972 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11357f5-4538-4567-af89-34156988230d admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:35.710631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acaeb5519174df1b01e37dca9b5f60d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:35.717197 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acaeb5519174df1b01e37dca9b5f60d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:35.717861 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acaeb5519174df1b01e37dca9b5f60d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:35.726001 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acaeb5519174df1b01e37dca9b5f60d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:35.737736 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acaeb5519174df1b01e37dca9b5f60d'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:35.743854 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1413/2844] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:29:35 2022] DELETE /identity/v3/users/2acaeb5519174df1b01e37dca9b5f60d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:35.748756 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:35.749284 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:35.749393 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:35.767592 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:35.768776 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:35.835963 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1432/2845] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:29:35.847857 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:35.849487 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:35.906919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11357f5-4538-4567-af89-34156988230d admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:35.910924 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:35.911569 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:35.911853 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:35.912111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:35.921809 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:35.923285 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720e46-59e5-4177-b6f2-17e9a76a34e4 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:35.932822 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1414/2846] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:36.218294 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.219944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:36.232435 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b5f4c-5a4b-4399-9f79-802831c5b300 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.237818 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.239027 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.239312 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.239695 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] PATH_INFO: `/v3/projects/346b515a7de94c959094673e350f9518` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.241680 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=346b515a7de94c959094673e350f9518)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.244121 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.293555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346b515a7de94c959094673e350f9518', 'request_id': 'req-04321819-8c38-406c-8c85-13bf7f388a0a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:36.299208 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346b515a7de94c959094673e350f9518', 'request_id': 'req-04321819-8c38-406c-8c85-13bf7f388a0a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:36.310216 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346b515a7de94c959094673e350f9518', 'request_id': 'req-04321819-8c38-406c-8c85-13bf7f388a0a'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:36.326798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] The token cache is being invalidate because project 346b515a7de94c959094673e350f9518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:29:36.327088 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:36.327804 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-04321819-8c38-406c-8c85-13bf7f388a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:36.329460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1433/2847] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:29:36 2022] DELETE /identity/v3/projects/346b515a7de94c959094673e350f9518 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:36.334577 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3098118-3628-411e-a295-093f31d7484c None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.334863 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3098118-3628-411e-a295-093f31d7484c None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.335131 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3098118-3628-411e-a295-093f31d7484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.353571 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-a3098118-3628-411e-a295-093f31d7484c None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:36.354762 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-a3098118-3628-411e-a295-093f31d7484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:36.418748 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1415/2848] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:36.428387 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.428649 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.428942 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.447862 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:36.449047 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:36.460258 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1434/2849] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:36.467407 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3098118-3628-411e-a295-093f31d7484c None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.482744 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3098118-3628-411e-a295-093f31d7484c None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.488705 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.489362 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.489639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.489909 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.490674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79875) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 20 16:29:36.490977 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.492591 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.505233 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1416/2850] 10.222.0.18 () {58 vars in 1152 bytes} [Sun Mar 20 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 20 16:29:36.510040 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.520166 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96df6e-216c-425f-801e-e9dce11b9874 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.526143 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.526846 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.527128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.527390 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.528073 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.530017 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.564490 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1435/2851] 10.222.0.18 () {60 vars in 1152 bytes} [Sun Mar 20 16:29:36 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:36.568986 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.579623 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718bfa-66a8-4189-b184-4c4b2f44a2e7 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.636511 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.637130 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.637428 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.637704 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] PATH_INFO: `/v3/users` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.638437 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.640464 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.664674 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1417/2852] 10.222.0.18 () {60 vars in 1143 bytes} [Sun Mar 20 16:29:36 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 20 16:29:36.720665 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.738916 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d3ec9-c6ef-46f7-8908-f67181b61d0e admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.747905 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.748922 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.749548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.749548 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] PATH_INFO: `/v3/roles` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.750165 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.751787 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.763095 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1436/2853] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:36.767492 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.778835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bab2-7064-4bae-a0cc-4b989aae1d49 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.784262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.784918 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.785201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.785477 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.786211 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.787881 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75612-e2c7-4408-ba6f-e1264ca4ab14 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.797774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1418/2854] 10.222.0.18 () {58 vars in 1121 bytes} [Sun Mar 20 16:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 20 16:29:36.802279 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.812497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6576-4376-4376-8daa-8f0dc133627c admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:36.817621 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:36.818520 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] REQUEST_METHOD: `PUT` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.818795 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.819064 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] PATH_INFO: `/v3/projects/84271e8df893482b9af29e254d9d270b/users/0e653cb055b64d308b24010b6bd87f41/roles/05f5a690bee14e8396c0c920bcf0fb2b` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.833555 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84271e8df893482b9af29e254d9d270b, user_id=0e653cb055b64d308b24010b6bd87f41, role_id=05f5a690bee14e8396c0c920bcf0fb2b)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:36.836224 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:36.851447 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1437/2855] 10.222.0.18 () {60 vars in 1482 bytes} [Sun Mar 20 16:29:36 2022] PUT /identity/v3/projects/84271e8df893482b9af29e254d9d270b/users/0e653cb055b64d308b24010b6bd87f41/roles/05f5a690bee14e8396c0c920bcf0fb2b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:36.861726 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aab-e4ea-454b-ac6e-69fb6ee9c832 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:36.862017 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aab-e4ea-454b-ac6e-69fb6ee9c832 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:36.862299 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8aab-e4ea-454b-ac6e-69fb6ee9c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:36.888880 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-c71e8aab-e4ea-454b-ac6e-69fb6ee9c832 None None] MFA Rules not processed for user `0e653cb055b64d308b24010b6bd87f41`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:36.890031 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c71e8aab-e4ea-454b-ac6e-69fb6ee9c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:36.955003 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1419/2856] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:36.966545 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:36.968893 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:37.028909 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0dc5-1917-4ee4-a7b3-ab491e67d39b admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:37.033290 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4d9cf83f9e241549009f2e8b56e5767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:37.033929 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:37.034206 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:37.034509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:37.043982 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:37.045480 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:37.054436 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1438/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:38.410715 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:38.411256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:38.411256 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:38.429890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] MFA Rules not processed for user `0e653cb055b64d308b24010b6bd87f41`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:38.431108 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:38.438851 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1420/2858] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:39.182803 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:39.184572 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:39.255537 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d10989-d2aa-42c5-932e-081698c0086b service cinder] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:39.260333 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:39.260981 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:39.261256 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:39.261525 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:39.263283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:39.274762 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:39.276317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74df05-4822-404f-aa9c-70ccbc117b45 service placement] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:39.286497 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1439/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:41.698787 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:41.700835 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:41.791419 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65051de4-185b-4462-9efc-b75d791543e0 None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:41.797129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c61a24263474ff7926d416bedf11db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:41.797799 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:41.798079 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:41.798397 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:41.800220 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:41.813013 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:41.814659 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:41.826638 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1421/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:52.434004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5237-75d9-474d-a66f-f786cddf0392 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:52.434559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5237-75d9-474d-a66f-f786cddf0392 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:52.434559 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5237-75d9-474d-a66f-f786cddf0392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:52.452949 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-df4c5237-75d9-474d-a66f-f786cddf0392 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:52.454125 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-df4c5237-75d9-474d-a66f-f786cddf0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:52.512840 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1440/2861] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:52.560978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:52.562463 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:52.633073 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8e09-7b5c-417d-8a35-d92a89cb5c94 service nova] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:52.638562 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:52.639205 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:52.639483 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:52.639757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:52.647840 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:52.649441 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:52.657361 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1422/2862] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:29:53.191437 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cf68-0eec-4b61-ae70-bc30cd5b370e None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.191802 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cf68-0eec-4b61-ae70-bc30cd5b370e None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.192100 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cf68-0eec-4b61-ae70-bc30cd5b370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.210472 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-48d6cf68-0eec-4b61-ae70-bc30cd5b370e None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:53.211700 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-48d6cf68-0eec-4b61-ae70-bc30cd5b370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:53.219937 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1441/2863] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:29:53.232685 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:53.243639 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec242-8743-4cbc-bf4c-11661a12a113 service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:53.249222 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:53.249848 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.250125 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.250422 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.259068 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:53.260657 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:53.268629 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1423/2864] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:29:53.476217 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9d6-32a4-4f52-8e11-31203cde3e8a None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.476737 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9d6-32a4-4f52-8e11-31203cde3e8a None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.476859 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9d6-32a4-4f52-8e11-31203cde3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.495504 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-98ecb9d6-32a4-4f52-8e11-31203cde3e8a None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:53.496669 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-98ecb9d6-32a4-4f52-8e11-31203cde3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:53.504511 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1442/2865] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Mar 20 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 20 16:29:53.518217 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:53.529179 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2eb2-0ed4-4a98-9520-e2ab684cadae service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:53.535379 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:53.535962 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.536240 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.536509 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.544978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:53.546610 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:53.554498 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1424/2866] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:29:53.872855 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.873137 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.873405 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.892272 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] MFA Rules not processed for user `c40f1d846a554956a0d471e5718b8244`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:53.893491 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:53.901951 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1443/2867] 10.222.0.18 () {58 vars in 967 bytes} [Sun Mar 20 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:53.914512 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:53.925646 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a2f5-9cd3-40ae-9ead-b6ace4d770de service swift] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:53.932094 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8dbf02e3130431c9bc3a95a97e039c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:53.932734 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:53.933015 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:53.933288 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:53.941867 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:53.943531 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8912e-9951-4f8c-a79e-b868830f2327 service swift] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:53.951655 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1425/2868] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Mar 20 16:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 20 16:29:56.060364 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:56.121788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e37ac-e9fa-4551-a194-e594dc29fa08 None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:56.126431 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:56.127318 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:56.127773 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:56.128317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] PATH_INFO: `/v3/users/0e653cb055b64d308b24010b6bd87f41` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:56.129456 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e653cb055b64d308b24010b6bd87f41)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:56.131732 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:56.180149 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e653cb055b64d308b24010b6bd87f41'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.188712 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e653cb055b64d308b24010b6bd87f41'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.189300 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e653cb055b64d308b24010b6bd87f41'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.189903 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e653cb055b64d308b24010b6bd87f41'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.202046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e653cb055b64d308b24010b6bd87f41'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.214276 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1444/2869] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:29:56 2022] DELETE /identity/v3/users/0e653cb055b64d308b24010b6bd87f41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:29:56.218978 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] REQUEST_METHOD: `POST` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:56.219455 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:56.219556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:56.238593 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.auth.core [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] MFA Rules not processed for user `4122efe2c30943a090f74e733d8eea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79875) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:29:56.239836 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:56.303801 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1426/2870] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:29:56.316079 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:56.318575 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:56.374826 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716d116-4ddf-45c4-b898-f9c0837eb830 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:56.379325 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:56.379962 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:56.380235 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:56.380509 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:56.389886 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:56.391266 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8ca55-1a2c-40cb-a4c5-52a8b4c9c027 service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:56.400605 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1445/2871] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:29:56.583890 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:29:56.585367 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:29:56.597766 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a144a-1193-4db4-80a5-1473b90e496f None None] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:29:56.603262 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:29:56.604129 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:29:56.604404 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:29:56.604644 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] PATH_INFO: `/v3/projects/84271e8df893482b9af29e254d9d270b` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:29:56.605892 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84271e8df893482b9af29e254d9d270b)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:29:56.607901 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:29:56.656327 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84271e8df893482b9af29e254d9d270b', 'request_id': 'req-baf5c997-8573-4143-bfb6-e0e2a4a1f221'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.662371 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84271e8df893482b9af29e254d9d270b', 'request_id': 'req-baf5c997-8573-4143-bfb6-e0e2a4a1f221'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.668513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84271e8df893482b9af29e254d9d270b', 'request_id': 'req-baf5c997-8573-4143-bfb6-e0e2a4a1f221'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.683682 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] The token cache is being invalidate because project 84271e8df893482b9af29e254d9d270b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79875) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:29:56.683968 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.684631 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:29:56.686198 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1427/2872] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:29:56 2022] DELETE /identity/v3/projects/84271e8df893482b9af29e254d9d270b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:30:47.663328 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] REQUEST_METHOD: `POST` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:30:47.663892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:30:47.663892 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:30:47.700128 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.auth.core [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] MFA Rules not processed for user `680e952402064e01bd046039bc6f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 20 16:30:47.701350 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:30:47.774265 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1446/2873] 10.222.0.18 () {58 vars in 957 bytes} [Sun Mar 20 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 20 16:30:48.109550 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:30:48.111221 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:30:48.209627 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c997-8573-4143-bfb6-e0e2a4a1f221 admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:30:48.213534 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:30:48.214183 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:30:48.214514 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:30:48.214793 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:30:48.216742 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:30:48.227008 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:30:48.228465 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:30:48.236882 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1428/2874] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:30:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:32:02.140625 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:02.142233 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:02.251368 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62869f63-ae73-4f23-8138-ef0c3c58e3ba None None] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:02.257632 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:02.258283 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:02.258565 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:02.258838 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:02.260782 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:02.273220 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:02.274902 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:02.285346 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1447/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:32:33.844122 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:33.846560 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:33.857919 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2b54-e8cb-43a8-8cd9-dbc68ad371c3 service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:33.862574 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:33.863204 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:33.863479 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:33.863749 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:33.865841 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:33.878160 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:33.880010 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:33.890384 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1429/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:32:48.389046 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:48.398875 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c190-88d0-41f1-a46f-819a19b460f1 service placement] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:48.403467 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff2fae13e4b40b5b61775a27747fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:48.404104 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] REQUEST_METHOD: `GET` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:48.404383 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:48.404645 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:48.406758 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:48.494428 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:48.495798 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:48.515952 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1448/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 20 16:32:54.818556 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:54.820660 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:54.835990 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b237b-bcad-4c70-8511-ea07afb2c43b service neutron] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:54.841105 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:54.842007 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:54.842513 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:54.842788 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] PATH_INFO: `/v3/users/680e952402064e01bd046039bc6f33e3` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:54.844011 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=680e952402064e01bd046039bc6f33e3)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:54.845944 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:54.902810 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680e952402064e01bd046039bc6f33e3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:54.909236 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680e952402064e01bd046039bc6f33e3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:54.909903 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680e952402064e01bd046039bc6f33e3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:54.918004 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680e952402064e01bd046039bc6f33e3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:54.929111 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680e952402064e01bd046039bc6f33e3'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:54.935009 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1430/2878] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:32:54 2022] DELETE /identity/v3/users/680e952402064e01bd046039bc6f33e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:32:55.380554 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:55.390728 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d9432-4d26-41dd-a38d-11faae5d740a service neutron] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:55.448788 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:55.449661 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:55.449944 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:55.450214 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] PATH_INFO: `/v3/projects/418f04c79658426bb30906d8f9da01ec` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:55.451460 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418f04c79658426bb30906d8f9da01ec)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:55.453370 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:55.503501 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418f04c79658426bb30906d8f9da01ec', 'request_id': 'req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.509168 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418f04c79658426bb30906d8f9da01ec', 'request_id': 'req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.517977 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418f04c79658426bb30906d8f9da01ec', 'request_id': 'req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.529354 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] The token cache is being invalidate because project 418f04c79658426bb30906d8f9da01ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:32:55.529640 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.530317 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.531896 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1449/2879] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:32:55 2022] DELETE /identity/v3/projects/418f04c79658426bb30906d8f9da01ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:32:55.536200 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:55.537757 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:55.550932 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559c5e-fdb0-4f6e-be90-249a38c1e03c admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:55.606089 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:55.606984 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:55.607261 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:55.607563 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] PATH_INFO: `/v3/users/5d0f02c9f4db4885bbe6f01a628fabed` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:55.608774 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0f02c9f4db4885bbe6f01a628fabed)` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:55.610723 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:55.658939 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0f02c9f4db4885bbe6f01a628fabed'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.666074 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0f02c9f4db4885bbe6f01a628fabed'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.666875 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0f02c9f4db4885bbe6f01a628fabed'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.676047 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0f02c9f4db4885bbe6f01a628fabed'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.688329 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.notifications [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0f02c9f4db4885bbe6f01a628fabed'} {{(pid=79875) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:55.694763 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1431/2880] 10.222.0.18 () {58 vars in 1223 bytes} [Sun Mar 20 16:32:55 2022] DELETE /identity/v3/users/5d0f02c9f4db4885bbe6f01a628fabed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:32:55.876392 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Authenticating user token {{(pid=79876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:32:55.877934 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.fernet_utils [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:32:55.891731 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ece7-6e3c-47da-82bc-dac0d4bca0f5 admin admin] Validating token access rules against request {{(pid=79876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:32:55.950065 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4122efe2c30943a090f74e733d8eea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c02cce03c9e142bab39baeb17444c822', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:32:55.950961 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:32:55.951231 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:32:55.951499 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] PATH_INFO: `/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73` {{(pid=79876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:32:55.952673 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367002c1dd8e4ea0b36ef0bb007d7b73)` {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:32:55.954612 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] RBAC: Authorization granted {{(pid=79876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:32:56.002209 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367002c1dd8e4ea0b36ef0bb007d7b73', 'request_id': 'req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:56.008308 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367002c1dd8e4ea0b36ef0bb007d7b73', 'request_id': 'req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:56.017365 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367002c1dd8e4ea0b36ef0bb007d7b73', 'request_id': 'req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4'} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:56.029004 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] The token cache is being invalidate because project 367002c1dd8e4ea0b36ef0bb007d7b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 20 16:32:56.029286 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:56.029910 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: DEBUG keystone.notifications [None req-078cc97e-ec8d-4898-9a8d-b3b9f899dfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 20 16:32:56.031488 dv-cinder-834172-2-iscsi devstack@keystone.service[79876]: [pid: 79876|app: 0|req: 1450/2881] 10.222.0.18 () {58 vars in 1232 bytes} [Sun Mar 20 16:32:55 2022] DELETE /identity/v3/projects/367002c1dd8e4ea0b36ef0bb007d7b73 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 20 16:37:08.088594 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Authenticating user token {{(pid=79875) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 20 16:37:08.090290 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:37:08.162552 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1527b-6b04-47f3-a61d-8d92a43e752e admin admin] Validating token access rules against request {{(pid=79875) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 20 16:37:08.225201 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54281300b2394a829de25d19bebde181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43d4d70875464df4a5eaf859e71356f1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79875) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 20 16:37:08.225893 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] REQUEST_METHOD: `GET` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 20 16:37:08.226168 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] SCRIPT_NAME: `/identity` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 20 16:37:08.226491 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79875) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 20 16:37:08.228472 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.fernet_utils [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79875) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 20 16:37:08.240191 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 20 16:37:08.241777 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a3e89-cfb9-44ee-a7b5-d8f77b49cea2 service placement] RBAC: Authorization granted {{(pid=79875) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 20 16:37:08.251831 dv-cinder-834172-2-iscsi devstack@keystone.service[79875]: [pid: 79875|app: 0|req: 1432/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Mar 20 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)